COST  ANALYSIS  FOR  PLANNING -PROGRAMMING -BUDGETING 
COST-BENEFIT  STUDIES 

J.  D.  McCullough 
November  1966 


c 


P-3479 


g-ooqo  lOLib  3 


COST  ANALYSIS  FOR  PLANN INC -PROGRAMMING- BUDGETING 


\  } 

s'? 


COST-BENEFIT  STUDIES 

★ 

J.  0.  McCullough 
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I .  INTRODUCTION 

The  current  Interest  In  developing  a  Planning,  Progranmlng ,  ^ 

Budgeting  System  (PPBS)  In  non-defen'ie  agencies  stems  to  a  large  degree* 
from  Its  success  In  the  Department  ol;  Defense  (DOD) .  It  Is  natural, 
therefore,  for  the  non-defense  agencies  to  look  at  DOD  experience  for 

*4.  - 

ideas.  For  example.  In  the  area  of  coat-benefit  studies,  an  Integral 
part  of  PpBS,  the  DOD  has  had  long  experience.  It  was  on  this  basis, 

I  understand,  that  I,  a  military  systems  coat  analyst,  was  asked  to  dis¬ 
cuss  principles  and  techniques  of  cost  analysis  in  support  of  cost- 
benefit  studies.  I  understand  that  others  In  the  course  of  this  seminar 
have  already  introduced  you  to  the  subject  of  cost-benefit  analysis. 

Although  the  basic  analytic  principles  are  the  same  for  studies 
conducted  both  for  DOD  and  for  non-defense  agencies,  the  DOD  area  is 
loaded  with  Jargon  and  I  find  It  difficult  to  use  DOD  case  studies  to 
illustrate  my  points.  I  have  developed  a  simplified,  hypothetical  cost- 
benefit  example  that  Involves  the  field  of  education  to  illustrate  the 

key  features  of  cfcst  analysis.  I  trust  that  any  HEW  personnel  in  the 

«■ 

audience  will  make  helpful  comments  to  improve  any  shortcomings  in  my 
examples . 
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Any  vle-'S  expressed  in  this  paper  are  those  of  the  author.  They 
should  not  be  interpreted  as  reflecting  the  views  of  The  RAND  Corpora¬ 
tion  or  the  official  opinion  or  policy  of  any  of  its  governmental  or 
private  research  sponsors.  Papers  are  reproduced  by  The  RAND  Corpora¬ 
tion  as  a  courtesy  rfi>  members  of  its  staff.  , 

This  paper  was  prepared  for  presentation  at  a  series  of  three-week 
seminars  on  "Planning,  Programming,  and  Budgeting"  which  are  being  con¬ 
ducted  by  the  Office  of  Career  Development,  J.S.  Civil  Service  Coomission , 
in  cooperation  with  the  University  of  Maryland.  Attendees  are  civil 
service  employees  who  will  be  involved  in  the  Implementation  and  opera¬ 
tion  of  the  Planning,  Programming,  and  Budgeting  System  (PPBS)  In  non¬ 
defense  agencies. 

★  ★ 

fost -bene fit  analysis  Is  also  referred  to  as  cos f  -uti 1 i ty  analy¬ 
sis,  cost-effectiveness  analysis,  or  systems  analysis. 
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I  assume  that  moat  of  you  will  be  consumers  of  cost  estimates; 
however,  some  of  you,  especially  In  the  smaller  agencies,  may  )>e  cfcst  as 
generators  of  cost  estimates  as  well.  While  my  talk  today  Is  addressed 
primarily  to  the  consumers  of  cost  estimates,  this  discussion  can  per¬ 
haps  serve  as  a  starting  point  for  those  of  you  who  may  be  newly  desig¬ 
nated  as  cost  analysts. 

The  general  sequence  of  my  remarks  will  be,  first,  a  review  of  the 
role  of  cost-benefit  studies  as  a  planning  tool  and  the  role  of  cost 
analysis  therein;  then  a  review  of  the  principles  and  techniques  of  cost 
ing  individual  systems;  and,  finally,  the  costing  of  groups  of  systems. 

II.  THE  ROI "  OF  COST- BENEFIT  ANALYSIS* 

Let  me  quickly  review  the  role  of  cost-benefit  analysis.  This 
will  serve  to  insure  that  we  are  on  common  ground.  I  realize  that  you 
have  already  had  some  exposure  during  this  seminar  to  cost-utility  anal¬ 
ysis,  so  I  will  be  very  brief. 

To  begin  with,  cost-benefit  analysis  is  a  tool  employed  in  the 
analytical  process  considerations  of  Program  Budgeting,  as  opposed  to 
the  structural  aspects  or  the  information  svstem  considerations. 

The  structural  aspects  of  program  budgeting  are  concerned  with  es¬ 
tablishing  a  set  of  categories  oriented  primarily  toward  the  "end-product 
activities  that  are  meaningful  from  a  long-range-planning  point  of  view. 

Information  system  considerations  deal  with  (1)  progress  reporting 
and  control  and  (2)  providing  data  and  information  to  serve  as  a  basis 
for  the  analytical  process. 

Analytical  process  considerations  pertain  to  various  study  activ¬ 
ities  conducted  as  an  integral  part  of  the  program-budgeting  process. 

The  analytical  process  in  PPBS  covers  the  entire  spectrum  from 
long-range  planning,  to  programming ,  to  budgeting,  and  the  analytical 
techniques  employed  vary  with  each  part  of  the  spectrum.  I  want  to 
focus  on  one  analytics  1  tPchi ique ,  that  of  cost-benefit  analysis. 

Cost-benefit  analysis,  although  not  restricted  in  its  application 
to  long-range  planning  problems,  is  a  most  useful  tool  for  such  plan¬ 
ning,  particularly  when  a  wide  range  of  alternative  future  courses  of 
action  needs  to  be  examined  in  a  broad  context. 


For  an  extensive  discussion,  see  Novick  [1],  Chap.  3. 
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Prest  and  Turvey  define  coat-benefit  analysis  aa  "a  practical  way 
of  aasesalng  the  desirability  of  projects,  where  it  is  important  to 
take  a  long  view  (in  the  sense  of  looking  at  repercuaslona  in  the  fur¬ 
ther,  as  well  as  the  .earer,  future)  and  a  wide  view  (in  the  aenae  of 
allowing  for  aide-effects  of  many  kinds  of  many  persona,  Industries, 
regions,  etc.),  l.e.,  it  implies  the  enumeration  and  evaluation  of  all 
the  relevant  costs  and  benefits."* 

To  recap,  coat-benefit  analysis  la  a  tool  for  long-range  planning. 

1  will  thus  be  discussing  cost  analysis  as  a  part  of  this  tool  for  long- 
range  planning.  I  will  not  be  talking  about  techniques  for  preparation 
of  estimates  for,  say,  the  funding  of  next  year's  budget,  or  for  man¬ 
aging  systems  once  the  decision  to  develop  or  produce  has  been  made. 

Cost  analysis  for  these  purposes  takes  a  much  different  form. 

III.  THE  ROLE  OP  COST  IN  COST-BENEFIT  ANALYSIS 

Before  proceeding  to  diacusa  the  principles  and  techniques  of  cost 
analysis  in  support  of  cost-benefit  studies,  I  would  like  to  mention 
the  role  of  cost  in  these  studies.  First,  I  wish  to  review  with  you 
the  tests  for  preferredness  in  cost-benefit  studies,  for  it  is  in  these 
tests  that  costs  and  benefits  are  related. 

Cost-benefit  analysis  helps  us  in  choosing  the  most  desirable  among 
the  alternative  means  to  our  ends.  To  make  a  meaningful  choice  requires 
that  we  have  criteria  or  tests  for  preferredness.  The  generally  suit¬ 
able  form  of  criterion  is  the  maximization  of  the  present  value  of  all 

benefits  less  that  of  all  costs  if  both  can  be  expiessed  in  the  same 
★★ 

unit.  If  they  cannot  be  so  expressed,  then  the  suitable  forms  are 
Prest  and  Turvey  [2],  p.  683. 

Money  invested  at  some  rate  of  interest  will  increase  in  value 
over  time.  For  example,  $100  invested  today  at  6X  interest  will  amount 
to  $106  one  year  from  now.  Looking  at  it  in  another  way,  $106  one  year 
in  the  future  is  worth  only  $100  at  present,  if  money  is  worth  6%. 

The  sum  $100  is  called  the  present  value  of  $106,  one  year  in  the  future 
if  money  is  worth  6X.  The  $106  is  discounted  at  67.  to  determine  the 
present  value. 
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maxlmlzitlon  of  gain  for  a  specified  cost  or  the  minimization  of  cost 

it 

for  achieving  a  sp^rlfied  gain. 

Lee  me  Illustrate  these  criteria  by  a  hypothetical  case  study. 

Thla  basic  case  will  be  used  repeatedly  throughout  the  paper;  therefore, 

1  will  present  it  in  some  detail  for  the  first  illustration. 

Assume  that  in  an  east  coest  metropolitan  area  there  are  30,000  high 
school  dropouts  per  year.  The  federal  government  has  established  an 
objective  to  train  part  or  all  of  them  by  means  of  a  one-year  intensive 
training  course  which  will  make  them  employable  at  a  certain  skill  level 
10  years  earlier  than  if  they  had  to  attain  this  skill  level  on  their 
own.  The  benefits  thus  run  for  10  years.  To  provide  the  training,  as¬ 
sume  that  we  must  build  entirely  new  schools,  hire  all  new  teachers, 
etc.,  end  that  the  program  itself  will  last  10  years.  There  are  two 
alternative  means  to  achieve  the  objective.  Consider  that  each  of  these 
means  constitutes  a  "system."  A  system,  therefore,  would  be  viewed  as 
a  combination  of  resources  brought  together  to  achieve  a  specific  ob¬ 
jective.  System  A  is  an  equipment -oriented  approach  involving  exten¬ 
sive  use  of  computers,  programmed  learning  techniques,  etc.  It  has  only 
50  teachers  per  school  and  a  student-teacher  ratio  of  60:1.  System  B 
Is  a  teacher -oriented  approach  involving  team-teaching  techniques.  It 
has  200  teachers  per  school  and  a  10:1  student-teacher  ratio.  The  stu¬ 
dent  capacity  at  schools  for  System  A  is  3000  and  for  System  B,  2030. 

Assume  further  that  the  costs  (which  I  will  define  in  detail  in 
later  sections)  for  each  system  are  summarized  below  (in  millions). 


System  A 

System  B 

Development  - 

$150.0 

$10.0 

Investment  per  school  - 

5.0 

A  .0 

Operations  per  year  per 
school  - 

1.5 

3.0 

We  are  now  ready  to  examine  how  costs  and  benefits  are  related  in 
the  tests  for  preferredness.  First,  let  us  assume  that  the  benefits 


*McKean  [ 3  J ,  p.  97. 
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and  the  costs  cannot  be  measured  in  the  same  unit,  that  la,  the,  are 
Incommensurable.  In  our  case,  gains  are  measured  In  numbers  of  students 
trained  and  costs  are  measured  In  dollars.  Because  our  decisionmakers 
do  not  know  the  level  of  training  they  wish  to  support,  we  must  develop 
a  schedule  of  costs  and  benefits  over  the  full  range  of  student* 
(0-30,000).  For  convenience,  let  us  assume  that  the  costs  are  contin¬ 
uous  In  nature;  that  Is,  we  can  buy  schools  of  varying  sizes. 

The  student  lot:!  capability  la  charted  on  the  top  part  of  Fig.  1. 
System  A  requires  10  schools  for  30,000  students  and  B  requires  15. 


Fig.l — Student  capacity  and  system  costs  versus  number 
of  »chools  for  alternative  systems  A  and  B 
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The  system  costs  (Development,  Investment  and  10  years  of  Operating 
Cost)  are  charted  on  the  bottom  part  of  Fig.  1,  and  are  sunmarized  below; 


COSTS 

(In  millions  of  dollars) 


System  A  System  B 


Schools 

R&D 

Inv 

Ops 

Total 

R&D 

Inv 

Ops 

Total 

0 

150 

150 

10 

10 

10 

150 

50 

150 

350 

10 

40 

300 

350 

15 

150 

75 

225 

450 

10 

60 

450 

520 

We  can  nov  combine  benefit  (student  crpaclty--aaaumed  to  be  equal 
to  students  trained)  and  costs  into  one  chart  (Fig.  2)  by  eliminating 
the  common  denominator,  number  of  schools. 


Fig. 2  —  Student  capacity  versus  system  costs  for  alternative 
systems  A  and  B 
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Recognizing  Chat  non -quantifiable  factors  will  enter  into  the  de¬ 
cision,  but  whose  discussion  will  be  omitted  here  for  simplicity,  we 
can  choose  the  best  system  given  either  a  fixed  budget  or  a  specified 
level  of  benefit.  I  have  Indicated  the  envelope  of  optimum  costs  to 
benefits.  For  all  budgets  under  $242  million,  System  B  is  preferred 
because  it  will  have  a  greater  student  capacity.  For  example,  at  a 
$200  million  budget,  System  B  has  a  capacity  of  about  11,000  students, 
while  A  has  about  8,000.  For  all  levels  greater  than  $242  million, 
System  A  is  preferred. 

Conversely,  for  all  student  loads  less  than  13,600,  System  B  is 
preferred  becai  se  it  will  cost  less  than  System  A.  Above  13,600, 

System  A  is  preferred.  For  example,  at  a  24,000  student  load,  System  A 
will  cost  $310  million  whereas  System  B  will  cost  $418  million. 

Although  the  above  illustrations  have  been  extremely  simplified, 
they  show  how  cost  and  benefits  interact  when  they  are  incommensurable . 

Again  using  the  same  basic  case,  assume  that  each  student  trained 
will  Increase  his  earnings  such  that,  for  the  10-yeer  period,  taxes 
paid  to  the  government  will  be  Increased  by  $250  each  year  and  that  un¬ 
employment  benefits  of  $250  per  year  will  not  have  to  be  paid.  The 
government,  therefore,  has  the  opportunity  to  use  this  $250  in  some 
other  way.  The  net  gain  to  the  government  is  therefore  $500  per  stu¬ 
dent  per  year  or  $5000  for  the  10-year  period. 

Recall  that  our  criterion  for  choice  is,  for  a  given  Investment, 
the  maximization  of  present  worth,  i.e.,  the  present  value  of  the  bene¬ 
fits  less  that  of  the  costs.  We  must  now  compute  the  time-phased  bene¬ 
fits  and,  using  an  appropriate  interest  rate,  discount  the  benefits  to 
a  present  value.  Again,  the  system  costs  would  be  developed  as  before, 
but  in  this  case,  they  would  be  time-phased  and  discounted  to  a  pres¬ 
ent  value.  Such  time-phased  costs  and  benefits  for  one  level  of  stu¬ 
dent  capacity  are  portrayed  on  Table  1,  together  with  the  present  value 
of  each,  based  on  the  arbitrary  assumption  that  money  is  worth  67..* 


The  discount  rate  selected  above  is  meant  to  reflect  only  the 
time  preference  for  money  and  not  the  r'sk  associated  with  the  project. 
See  Hitch  [7],  pp.  209-210.  See  also  McKean  [3],  Chap.  5,  for  an  ex¬ 
tensive  discussion  of  time  streams  and  criteria. 
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Table  1 

PRESENT  WORTH  CALCULATION  -  6  PERCENT  DISCOUNT  RATE 
ALTERNATIVE  SYSTEM  A  -  30,000  STUDENT  CAPACITY 

(In  millions  of  dollars) 


Year 

Schools 

in 

Operation 

i  Costs 

!  Benefits  i 

Present 

Worth 

Dev. 

Invest. 

Op. 

Total 

Present 

Value 

Total 

Present 

Value 

1 

75. 

75. 

70.8 

_  _ 

m  m 

2 

•  - 

75. 

75. 

66.8 

-- 

3 

-- 

50. 

50. 

42.0 

-- 

4 

10 

15. 

15. 

11.9 

-- 

5 

10 

15. 

15. 

11.2 

15. 

11.2 

6 

10 

15. 

15. 

10.6 

30. 

21.1 

7 

10 

15. 

15. 

10.0 

45. 

29.9 

8 

10 

15. 

15. 

9.4 

60. 

37.6 

9 

10 

15. 

15. 

8.9 

75. 

44.4 

10 

10 

15. 

15. 

8.4 

90. 

50.2 

11 

10 

15. 

15. 

7.9 

105. 

55.3 

12 

10 

15. 

15. 

7.5 

120. 

59.6 

13 

10 

15. 

15. 

7.1 

135. 

63.6 

14 

-- 

150. 

66.6 

15 

135. 

56.3 

16 

120. 

47.2 

17 

105. 

39.0 

18 

90. 

31.5 

19 

75. 

24.8 

20 

60. 

18.7 

21 

45. 

13.2 

22 

30. 

8.3 

23 

15. 

3.9 

Total 

150. 

50. 

150. 

350. 

272.5 

1500. 

682.4 

409.9 

I  have  allowed  two  years  for  the  period  of  development  and  test  and  one 
year  to  build  the  schools  and  Install  equipment.  The  schools  operate 
for  10  years,  graduating  a  total  of  30,000  students  each  year.  The 
graduate  students  build  up  in  30,000  increments  to  a  maximum  of  300,000 
graduates  receiving  benefits.  This  group  phases  down  by  30,000  decre¬ 
ments  as  the  assumed  benefit  period  of  10  years  ends  for  each  class. 

The  present  value  of  the  costs  is  $272  million  and  of  the  benefits  is 
$682  million,  a  present  worth  of  $410  million.  Similar  calculations 
for  the  other  levels  of  student  capacity  produce  the  chart  of  costs  and 
benefits  shown  in  the  top  part  of  Fig.  3.  This  is,  in  turn,  presented 


Present  worh  (millions  of  $)  Present  value 


Fig. 3  —  Present  worth  of  alternative  systems  A  and  B 
(6%  discount  rate) 


10- 


ln  present  worth  terms  on  the  bottom  part  of  Fig.  3.  Because  of  the 
shape  of  the  time  streams  of  cost  and  benefits  and  the  discount  rate 
selected,  there  is  a  shift  in  the  cross-over  point  for  preferring  Sys¬ 
tem  A  to  System  B  from  the  undiscounted  case.  The  shift  now  occurs  at 
about  20,000  students,  rather  than  13,600  students.  Both  systems  have 
a  negative  net  worth  under  about  800  students  and  System  A  continues 
to  have  such  for  up  to  7500  students.  Again,  one  can  draw  an  envelope 
showing  the  best  course  of  action  (all  other  things  being  equal!). 

If  monev  la  worth  67.,  it  would  not  pay  to  invest  in  the  program  for 
leas  than  800  students.  System  B  would  maximise  returns  for  student 
capacity  up  to  20,000  and  Syster  A  would  maximize  returns  thereafter. 
Conversely,  funds  of  about  $225  million  or  more  should  be  Invested  in 
System  A  and  funds  of  less  than  that  in  System  B. 


IV,  FEATURES  OF  SYSTEMS  COST  ANALYSIS 

Now  that  we  have  reviewed  the  way  in  which  system  costs  are  used 
in  cost-benefit  analysis,  let  us  turn  to  a  discussion  of  the  distinctive 
features  of  systems  coat  analysis.  What  are  the  characteristics  which 
ret  it  apart  from  other  types  of  cost  analysis?  While  any  list  of  fea¬ 
tures  is  somewhat  arbitrary,  I  believe  that  the  more  Important  of  these 
are  as  follows: 

1.  End-product  orientation, 

2.  Extended  time  horizon. 

3.  Incremental  costing. 

4.  Life  cycle  costs  . 

5.  Dollars  as  the  measure  of  resources. 

6.  Analytical  approach  and  statistical  techniques. 

i.  End-product  Orientation.  Cost-benefit  analysis  has  as  a  basic 

principle  the  identification  and  analysis  of  a  "system" --a  means  by 

★ 

which  an  objective  may  be  accomplished.  The  PPBS  term  is  "Program 
Element--an  Integrated  activity  which  combines  personnel,  other  sei  vices  , 

irk 

equipment  and  facilities." 

*See  Quade  [4],  p.  13. 

**See  BOB  Clr.  66-3  [5],  p.  4. 
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Tha  end-product  orientation  of  coat  analysis  reflects  this  "systems" 
approach.  It  Is  a  basic  principle  of  systems  cost  analysis  that  re¬ 
quirements  for  diverse  resources  be  Identified  and  associated  with  end- 
products  such  as  the  new  school  systems  In  the  case  of  our  Illustration, 
or  transportation  systems  such  as  a  supersonic  transport  or  a  turbine 
train.  The  lmnedlate  problem  Is  to  Identify  all  costa  associated  with 
the  selection  of  a  particular  system.  This  reflects  the  view  that  de¬ 
cisions  must  not  be  based  solely  on  the  cost  of  the  major  equipment, 
or  solely  on  personnel  requirements,  or  on  any  other  particular  resource 
associated  with  the  system,  no  matter  how  critical  Its  role.  Instead, 
the  cost  of  a  system  should  reflect  the  total  resource  Impact  of  the 
decision  relating  to  that  system.  Identifying  and  Indicating  the  mag¬ 
nitude  c  ’  all  relevant  costa  of  a  particular  system  or  course  of  action 
is  the  basic  purpose  of  a  cost  estimate. 

2.  Extended  Time  Horizon.  Aa  previously  stated,  cost-utility 
analysis  Is  a  tool  for  long-range  planning,  for  "taking  a  long  view  and 
a  wide  view."  In  particular,  development  decisions  are  often  required 
from  five  to  ten  years  before  a  system  can  be  brought  Into  being.  The 
span  of  time  covered  In  a  cost  analysis  must  be  sufficiently  long  to 
cover  such  lead  times.  Further,  the  time  horizon  must  cover  the  full 
period  of  a  system  operation  and  for  the  period  of  Its  benefits.  In 
our  case  study,  the  benefits  extended  for  ten  years  after  the  operation 
ceased,  'nd,  with  a  three -year  development  and  Investment  period,  a 
total  of  23  years  was  Involved.  The  extended  time  horizon,  therefore, 
becomes  an  integral  part  of  cost  analysis  in  its  application  as  a  tech¬ 
nique  for  longer  range  planning. 

I  might  point  out  that  this  extended  time  horizon  has  important 
Implications  for  the  development  of  cost  estimates.  It  brings  with  It 
a  great  deal  of  uncertainty,  and  the  farther  out  in  time  the  analysis 
Is  addressed,  the  greater  the  uncertainty.  Cost  analyses  of  systems 
envisaged  for  ten  years  In  the  future,  for  example,  often  constitute 
costing  equipment  never  before  produced  or  new  operations  never  before 
attempted.  Involved  are  new  materials,  new  manufacturing  processes, 
new  training  concepts--all  of  which  make  their  costing  difficult  and 
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the  resulting  estimates  uncertain.  Thus,  stress  Is  placed  on  the  com¬ 
parability  of  estimates  rather  than  on  their  absolute  values. 

3.  Incremental  Costing.  Cost  analysis,  like  cost-benefit  analy¬ 
sis  which  It  serves,  can  be  viewed  as  an  application  of  the  economic 
concept  of  marginal  analysis.  The  analysis  must  always  move  from  some 
bass  that  represents  the  existing  capability  and  the  existing  resource 
base.  The  problem  Is  to  determine  how  much  additional  resources  are 
needed  to  acquire  some  specified  additional  capability,  or  conversely, 
how  much  additional  capability  would  result  from  some  additional  ex¬ 
penditure.  It  Is,  therefore,  the  incremental  cost  that  is  relevant. 

The  economic  concept  of  marginal  analysis  Is  to  be  distinguished 
from  the  accounting  concept  of  associating  total  costs,  Including  an 
allocated  share  of  Indirect  expense,  to  an  end  Item  Ideally,  the 
Incremental  cost  of  a  system  is  the  difference  between  two  total  pro¬ 
grams,  one  with  the  system  and  one  without  It.  In  the  military  we  re¬ 
fer  to  the  costing  of  total  programs  as  "Total  Force  Structure  Costing" 
and  I  will  address  this  subject  later.  We  have  considerable  experience 
in  DOD  in  defining  the  Strategic  Forces  Program  and  can  develop  the 
total  program  with  and  without  a  new  strategic  system  reasonably  well. 

In  our  illustrative  case,  we  could  perhaps  define  the  Program  as  being 
government  outlays  for  Job  placement  training  In  area  X.  Figure  d  il¬ 
lustrates  the  Ideal  method  of  measuring  the  Incremental  cost  for  System  A-- 
by  comparing  two  total  programs. 

How  It  Is  quite  often  difficult  to  precisely  define  the  total  pro¬ 
gram  (or  total  programs  of  an  agency)  and  we  resort  to  making  reasonable 
assumptions  about  the  total  programs  and  concentrating  on  the  single 
systems  under  analysis.  We  did  this  In  our  illustrative  case  by  assum¬ 
ing  that  no  other  program  except  the  Job  placement  program  was  affected. 

It  is  possible  that,  had  we  had  the  ability  to  project  all  the  programs, 
we  could  have  observed  decreases  In  the  costs  for  police  and  emergency 
hospital  operation  (leas  crime),  but,  say  Increases  In  the  cost  for 
parks  and  recreation  (more  disposable  Income) . 

Sunk  Cos  ts .  In  measuring  Incremental  costs,  we  must  be  careful 
to  exclude  "sunk"  costs  (costs  expended  in  the  past).  Costs  which  have 
been  expended  In  the  past  are  simply  not  relevant  to  the  question, 
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"What  will  It  coat  in  the  future  to  acquire  a  future  capability?”  No 
natter  how  "unfair"  it  may  seem,  we  should  not  Include  the  past  costs, 
say  for  older  systems,  regardless  of  how  much  money  is  involved.  For 

example,  we  have  Invested  several  billion  dollars  in  the  SAGE  air  de- 

(1 

fense  system.  If  the  Federal  Aviation  Agency  (FAA)  wants  to  estimate 
the  cos ts  oZ  an  air  traffic  control  system  for  1970  which  would  include 
the  present  SAGE  system,  only  the  future  outlays  to  develop,  buy,  and 
operate  new  equipment  and  facilities  or  to  modify  and  operate  existing 
ones  should  be  considered,  the  several  billion  dollars  spent  in  prior 
years  should  have  no  bearing  on  the  decision  regarding  a  future  system. 

Now  I  did  not  say  that  the  resources  acquired  by  the  pas  expendi¬ 
tures  on  SAGE  should  be  excluded  from  our  analyses.  Should  s>-nk  ioctc 
result  in  inheritable  assets  (resources  which  will  become  available 
only  to  the  system  under  analysis)  the  sunk  costs  of  those  assets  should 
be  excluded.  Inheritable  assets  can  result  from  sunk  costs  on  many 
systems,  not  Just  the  ones  under  obvious  consideration,  and  it  is  Z.  ~ 
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this  reason  that  explicitly  coating  a  total  program  or  total  agency  la 
beat  because  all  systems  can  be  examined  and  a  better  picture  of  re  - 
aourcea  available  for  other  systems  re/ealed.  Conversely,  all  the  sys¬ 
tems  competing  for  these  assets  *re  revealed.  Thus  a  truer  picture  of 
net  asset  requirements  Is  shown. 

Let  me  Illustrate  these  points.  Recall  that  System  A  had  esti¬ 
mated  development  costs  of  $150  million  for  some  complicated  computer 
programs  and  equipment.  If  the  study  of  this  problem  was  delayed  two 
years  and,  meanwhile,  $30  million  per  year  had  been  Invested  In  the 
program,  then,  at  the  time  for  decisionmaking,  the  relevant  costs  would 
be  $90  million  ($150  million  less  $60  million)  assuming  no  change  in 
the  total  program  estimates.  The  $60  million  would  be  "sunk"  and  Irrel¬ 
evant.  Or,  as  concerns  today's  situation.  It  Is  possible  that  $100  mil¬ 
lion  has  already  been  expended  on  the  system  and  that  the  $150  million 
represents  future  coats  of  a  development  program  whose  total  cost  will 
be  $250  million. 

Regarding  Inheritable  assets,  let  us  assume  that  a  System  C  does 
exist  now  and  has  a  capability  of  training  10,000  students,  although  It 
Is  not  Judged  worthy  of  expansion.  It  has  50  teachers  per  school  and 
a  20:1  atudent-teacher  ratio.  While  the  buildings  and  equipment  could 
be  used  by  System  B  with  2000  students  per  school,  the  capacity  for 
System  C  la  only  1000  students.  System  A  cannot  use  System  C  facili¬ 
ties  because  It  needs  completely  new  facilities  for  Its  advanced  equip¬ 
ment.  If  we  assume  that  $3.0  million  per  school  are  saved  If  System  B 
utilizes  the  facilities  of  System  C,  the  system  costs  (In  millions)  become 


System  A 

System  B 

1st  10  Additional 

System  C 
(10  Schools) 

Development 

$150.0 

$10.0 

•  - 

Investment /school 

5.0 

1.0  4.0 

•  . 

Operations /year /school 

1.5 

3.0  3.0 

1.0 

The  charts  on  Fig.  1  then  become  as  shown  on  Fig.  5.  Unfortunately, 
the  investment  savings  for  System  B  were  not  very  significant,  so  that 
the  break  In  the  lyatem  costs  after  school  #10  is  not  sharp.  We  note 
that  System  C’s  coat  curve  stops  at  unit  10  because  we  do  not  plan  to 
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Student  copacity  (thousands) 


Fig. 6  —  Student  capacity  versus  system  costs  for  alternative 
Systems  A,  B  and  C 


expand  It.  System  A1 •  cost  curve  Is  unchanged  from  the  previous  situa¬ 
tion  because  It  cannot  Inherit  any  resources,  and  System  B's  cost  curve 
breaks  after  unit  10  when  facilities  can  no  longer  be  Inherited. 

In  case  you  are  Interested,  the  envelope  of  optimum  coat  to  bene¬ 
fits  now  looks  like  Fig.  6.  System  C  Is  preferred  for  all  student  loads 
up  to  10,000,  System  B  from  10,000  to  15,800  and  System  A  from  15,800 
to  30,000.  Conversely,  for  budget  levels  of  about  $165  million  or  less, 

System  C  Is  preferred,  (even  though  you  can  spend  only  $100  million  on 
C) ;  System  B  from  $165  million  to  about  $255  million;  and  System  A 
thereafter. 

4.  Life  Cycle  Costs.  One  distinctive  feature  of  systems  cost 
analysis  is  the  use  of  cost  categories.  System  costs  are  identified 
and  grouped  as  (1)  research  and  development,  (2)  Investment,  and  (3)  i 

annual  operating  costs.  These  cost  categories  reflect  the  llfa  cycle 
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approach  of  cose  analysis.  Lifa  cycle  costing  results  from  the  prin¬ 
ciple  that  the  funds  necessary  to  Initially  undertake  a  program  are  not 
the  primary  consideration,  nor  are  the  funds  required  In  any  particu¬ 
lar  time  period;  but  a  decision  to  undertake  a  particular  course  of 
action  should  taka  Into  account  Its  total  cost  Impact  over  time.  The 
cost  of  developing  the  system  must  be  accounted  for;  and  the  cost  of 
procuring  the  system,  and  also  the  coat  of  operating  It  as  a  component 
of  the  force,  must  be  taken  Into  consideration.  Definitions  of  the 
cost  categories  used  in  military  studies  are  as  follows: 

1.  Research  and  Development.  Costs  primarily  associated  with 
the  development  of  a  new  system  or  capability  to  the  point 
where  It  la  ready  for  Introduction  Into  operational  use. 

This  category  Includes  prototype  equipment  and  test  equip¬ 
ment  used  In  a  development  program. 

2.  lnv*»tMnt-  Costs  beyond  the  development  phase  to  Intro¬ 
duce  new  systems  or  a  new  capability  into  use. 

3.  Operations .  Recurring  costs  of  operating,  supporting,  and 
maintaining  the  system  or  capability. 

I  already  have  been  using  these  categories  In  my  illustrative  case. 
You  have  perhaps  already  noted  the  behavior  of  these  categories  as  a 
function  of  system  size.  A  system's  research  and  development  costs  are 
one-time  costs  and  are.  In  effect,  a  function  of  the  nature  of  the  sys¬ 
tem.  Research  and  development  costs  are  essentially  Insensitive  to  the 
number  of  units  of  the  system  that  will  be  procured  or  the  length  of 
time  that  the  system  will  be  In  operational  use. 

Investment  costs  are  a  function  of  the  number  of  units  planned  for 
the  system.  The  greater  the  number  of  units  to  be  Introduced  Into  the 
program,  the  higher  the  Investment  cost.  Such  costs  are  essentially 
one-time  costs  per  unit. 

Operating  costs  depend  on  both  the  number  of  units  In  the  program 
and  the  length  of  time  that  such  units  are  operated,  supported,  and 
maintained . 


System  cost  ($) 
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These  three  dlatlnct  categorlea  are  useful  In  making  program  de¬ 
ft 

clslons.  The  R&D  costa  are  concerned  with  development  decisions  and 
the  choice  among  feasible  alternatives.  We  can  develop  System  A  and 
thus  have  It  on  the  shelf  but  we  do  not  have  to  procure  It.  The  Invest¬ 
ment  coats  concern  the  extensiveness  of  the  system's  employment  or  the 
relative  Importance  that  the  system  should  occupy  In  the  program.  Hav¬ 
ing  once  developed  System  A  we  can  procure  a  capacity  of  from  1  to  10 
schools  depending  upon  our  situation.  The  operating  costs  concern  the 
manner  and  the  length  of  time  that  the  system  should  be  operated.  We 
chose  to  operate  them  10  years  In  our  example  but  we  could  have  varied 
this . 

Figure  7  depicts  cost  category  patterns  over  the  life  cycle  of  a 
system.  The  cost  category  levels  are  Illustrative  of  typical  patterns 
for  Individual  military  systems. 


Fig. 7 — Lifecycle  costs:  Illustration  of  system  "Life  Cycle"  identification 

plotted  against  time 

5.  Dollars  as  a  Measure  of  Resources.  The  purpose  of  cost  analy¬ 
sis  Is  to  develop  estimates  of  future  resource  requirements  fer  systems. 
Resource  requirements  are  stated  In  terms  of  equipment,  personnel  ,  real 


*The  R&D  decisionmaking  process  In  DOD  has  become  somewhat  more 
sophisticated  In  recent  years.  More  cost  categories  are  thus  appropri¬ 
ate  for  decisionmaking  In  DOD;  e.g,,  {1)  Conceptual;  (2)  Definition- 
Phase  IA;  (3)  Definition  Phase  IB;  (4)  Definition  Phase  IC.  See 
AFSCM  375  -5  ,  [6]. 
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facllltles,  supplies,  etc.  A  total  eyatem  coat  cannot,  however,  be 
developed  by  auoolng  over  such  a  heterogeneity  of  reaourcea  that  make 
up  a  ayateta.  Nor  could  understandable  comparisons  be  made  between  sys¬ 
tems  If  their  costa  were  expressed  solely  In  terms  of  varieties  of 

real  resources.  The  dollar  cost  of  such  resources  can  serve  the  pur- 

★ 

pose,  and  Is  the  nessure  selected  for  cost  estimating.  Of  course,  in 
estimating  a  system,  we  want  to  spell  out  the  Important  resources  In 
terms  of  their  quantities.  Critical  resources,  whose  supplies  are  quite 
limited,  such  as  technical  manpower,  should  be  given  separate  attention 
in  the  analysis. 

Further,  constant  dollars  are  nearly  always  used.**  Rarely  is  an 
attempt  made  to  predict  future  price  level  changes  In  comparing  or 
evaluating  alternatives  In  cosc-benaflt  studies.  Such  predictions  are 
extremely  difficult  to  make  and  many  problems  remain  to  be  solved.  Cost¬ 
ing  guidelines  for  DOD  studies  specify  that  constant  dollars  will  norm¬ 
ally  be  used. 

6.  The  Analytical  Approach  and  the  Use  of  Statistical  Techniques. 
Systems  under  study  are  often  technically  advanced  far  beyond  our  range 
of  experience.  In  the  early  consideration  of  such  systems,  specifica¬ 
tions  cannot  be  defined  with  exactness.  As  mentioned  earlier,  many  of 
the  components  of  future  systems  have  never  been  constructed  before, 
and  no  cost  experience  exists.  To  project  costs  beyond  the  range  of 
experience  places  the  emphasis  on  analytical  processes.  The  use  of 
statistical  methods  assists  In  this  analysis.  Data  on  past  and  exist¬ 
ing  systems  are  analysed  statistically  to  derive  relationships  between 
costs  and  the  system  characteristics  known  at  the  outset.  For  example, 
for  a  computerised  teaching  machine  for  System  A,  such  characteristics 
could  be  performance  characteristics  such  as  computational  speed  or 
physical  characteristics  such  as  memory  sise.  The  purpose  of  such  anal¬ 
ysis  Is  to  devalop  cost -estimating  relationships  (CERs)  suitable  for 
projecting  costs  of  future  systems.  Scatter  diagrams,  regression  analy¬ 
sis,  and  correlation  analysis  are  examples  of  statistical  techniques 
useful  In  the  development  of  such  cost -estimating  relationships. 

*For  a  more  detailed  discussion,  see  Hitch,  [7],  pp.  26-28. 

Frest  and  Turvey  [2],  p.  691. 
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V.  STEPS  OF  COST  ANALYSIS 

Now  that  we  have  reviewed  the  aallent  features  of  systems  cost 
analysis,  let  us  look  at  the  process  of  developing  cost  estimates. 

There  are  no  set  rules  or  fixed  procedures  which,  If  followed,  would 
Insure  the  successful  accomplishment  of  a  reliable  system  cost  estimate. 
However,  there  Is  a  general  approach  to  system  cost  estimating  that  can 
be  described.  This  approach  can  be  viewed  as  a  series  of  steps  In  the 
development  of  a  cost  estimate.  First,  let  us  look  at  a  summary  of 
these  steps: 

1.  Defining  the  problem.  What  is  to  be  costed  and  under  what 
context  and  ground  rules? 

2.  Obtaining  a  specific  systems 

a.  Equipment  description. 

b.  Operational  concepts  and  objectives. 

c.  Location  of  facilities. 

3.  Collecting  data  for  use  In  preparing  the  estimates. 

4.  Converting  the  systems  description  information  Into  a  state¬ 
ment  of  resource  requirements--ln  terms  oft 

a.  Equipment. 

b.  Facilities. 

c.  Trained  personnel. 

5.  Translating  the  statement  of  resource  requirements  Into  costs, 
using  as  a  vehicle  a  comprehensive  chart  of  cost  elements, 
which  highlights  the  significant  cost  areas  for  that  system. 

6.  Presenting  the  coat  estimates  In  terms  suitable  for  the  de¬ 
cisionmaker,  and  dealing  with  cost  sensitivity. 

7.  Documenting  the  analysis. 

Although  these  steps  are  outlined  as  though  they  are  sequential 
and  discrete,  there  Is,  In  the  practice  of  developing  cost  estimates, 
a  considerable  amount  of  lndeflnlteness  between  steps  and  a  good  deal 
of  looping  back  as  the  study  progresses.  For  example,  the  derivation 
of  cost  estimates  may  cause  the  system  analyst  to  reconsider  alterna¬ 
tives,  thereby  redefining  the  problem  for  the  cost  analyst.  The  deri¬ 
vation  of  the  estimate  could  also  Identify  needs  for  additional  data. 


^escrlption--ln  terms  of: 
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Further,  documentation  efforts  to  some  degree  mist  be  undertaken  at  the 
very  beginning  of  the  study.  It  should  be  kept  In  mind,  therefore, 
that  these  steps  In  reality  are  the  types  of  effort  performed  In  the 
development  of  a  cost  estimate.  We  will  now  expand  on  each  of  the  seven 
steps  listed. 

1.  Defining  the  Problem.  This  step  centers  on  the  relationship 
of  the  cost  analyst  to  the  director  of  the  cost-benefit  study.  Here 
the  task  is  to  assist  the  director  In  establishing  the  proper  analytical 
framework  from  a  "cost  analysis"  point  of  view.  Are  the  right  questions 
being  asked?  What  concept  of  cost  properly  fits  this  problem?  Etc. 

In  Insisting  that  the  cost  analyst  assist  in  establishing  the 
proper  framework  you  might  feel  that  I  have  strayed  fTom  the  path  of 
"making  a  cost  estimate"  Into  the  field  of  the  system  analyst,  but  I 
cannot  overatress  the  Importance  of  this  phase.  The  success  of  the  en¬ 
tire  study  literally  depends  upon  gooi  problem  formulation. 

A  major  product  of  the  "problem  definition"  phase  will  be  the  coat 

ground  rules  to  be  used  In  the  study.  The  gTound  rules,  in  effect,  rep- 

★ 

resent  the  assumptions  underlying  the  study.  Examples  of  study  ground 
rules  are  as  follows: 

(a)  Kind  of  cost  Index  to  be  used.  (Example:  R&D ,  Invest¬ 
ment  and  n  years  of  operating  cost  where  n  -  5  or  10  In 
current  Air  Force  studies.) 

(b)  Date  as  of  which  all  prior  costs  will  be  considered  sunk 
costs.  (Example:  FY  1967.) 

(c)  Rules  regarding  discounting  to  a  present  value. 

(d)  Rules  regarding  costs  of  other  agencies.  (Example:  for 
DOD,  the  nuclear  warhead  coats  incurred  by  the  Atomic 
Energy  Commission.) 

(e)  Special  rules  regarding  Indirect  costs  which  may  vary 
with  the  system,  such  as  support  personnel  on  a  facility 
which  houses  several  systems. 


ir 

Appendix  l  contains  an  excellent  example  of  general  cost  ground 
ruler  oriented,  of  course,  to  DOD  studies.  The  Costing  Guidelines  for 
DOD  Coat-Ef fectlvenass  Studies,  OASD  (SA)  ,  Resource  Analysis,  May  i, 
1966,  are  reproduced  for  convenient  reference. 
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2.  Obtaining  a  Specific  System  Description.  This  step  centers 
on  the  relationship  of  the  cost  analyst  to  the  systems  analyst.  The 
problem  definition  phase  requires  very  close  contact  between  the  cost 
analyst  and  the  systems  analyst  so  that  the  systems  to  be  costed  can 
be  described  adequately  for  costing  purposes.  That  Is,  the  systems  to 
be  costed  must  be  described  In  terms  of  their  cost-generating  properties 
Tills  Includes  Information  on: 

.  Equipment  description. 

.  Operational  concepts  and  objectives. 

.  Location  of  facilities. 

Systems  descriptions  needed  by  cost  analysts  can  differ  consider¬ 
ably  from  those  used  by  systems  analysts.  The  cost  analyst  needs  a  de  - 
scriptlon  of  the  system  oriented  to  his  own  "tools,"  l.e.,  the  chart 
of  cost  elements  and  the  format  of  his  Input  data,  such  as  cost  factors 
and  coat  estimating  relationships. 

For  example,  in  an  aircraft  system,  the  flying  hour  program  of  air¬ 
craft  le  usually  Important  for  costing  because  a  number  of  estimating 
relationships  are  stated  as  a  function  of  flying  hours,  while  many  per¬ 
formance  data  are  normally  of  lesser  Importance.  The  systems  analyst 
on  the  other  hand  la  usually  more  Interested  In  performance  aspects  of 
the  system,  say,  the  accuracy  of  the  navigation  equipment.  Hence,  the 
required  system  description  must  be  sensitive  to  the  requirements  of 
the  cost  analyst. 

DOD  cost  analysts  use  Informal  checklists  to  assist  them  In  devel¬ 
oping  the  system  description.  I  am  not  acquainted  with  any  published 
checklists  for  non-defense  agency  studies,  so  I  must  use  DOD  examples. 
These  checklists  vary  (1)  by  type  of  sys tem--e .g . ,  aircraft,  missile, 
space  shlp--and  (2)  by  the  phase  which  the  system  has  reached  at  the 
time  it  Is  costed--« ,g. ,  conceptual,  development,  acquisition,  operation 
Estimating  techniques  will  vary  with  the  phase  of  a  systems  development, 
and,  therefore,  so  will  the  questions  that  must  be  answered. 

*For  a  further  discussion,  see  M.V.  Jones,  [8],  pp.  38-54. 
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It  la  essential  that  the  checklists  which  the  cost  analyst  uses 
provide  information  in  the  form  and  terms  for  which  cost.es time ting  re¬ 
lations  and  factors  are  available  or  can  be  readily  developed.  For  ex¬ 
ample,  in  costing  aircraft  an  estimating  relationship  may  require  such 
data  as  empty  weight,  maximum  speed  at  altitude,  and  maximum  engine 
thrust.  The  checklist  used  to  assemble  a  system  description  must  help 
Insure  that  answers  to  these  questions  will  be  obtained.  Other  data, 
such  as  wing  span  or  wing  area  may  be  interesting,  but  irrelevant. 

3.  Collecting  Data.  Given  Che  system  description  information  and 
the  study  ground  rules  and  assumptions,  the  cost  analyst  must  then  pro¬ 
ceed  to  gather  the  necessary  data  In  preparation  for  estimating  the  re¬ 
source  requirements  and  the  dollar  costs.  It  is  difficult  to  describe 
beforehand  in  a  precise  way  the  means  of  handling  data  needs  for  spe¬ 
cific  projects.  This  is  so  primarily  because  data  needs  and  availabil¬ 
ity  vary  considerably  from  system  to  system.  Such  variations  stem  for 
the  most  part  from  the  status  (or  phase)  of  the  system,  i.e.,  whether 
the  system  is  in  the  conceptual,  development,  procurement,  or  opera¬ 
tional  phase.  As  a  system  progresses  through  the  various  phases --from 
the  conceptual  to  the  operational  phase--more  and  more  data  become 
available.  In  the  early  phases,  the  system  can  usually  be  described 
only  in  general  terms  but  as  it  evolves  and  enters  the  later  phases, 
contractor  data  and  data  from  various  ocher  sources  become  available 
in  richer  detail . 

Although  the  comments  regarding  collecting  data  have  focused  on 
its  collection  for  a  specific  system,  there  will  exist  in  a  cost  organi¬ 
zation  an  on-going  activity  of  data  gathering  that  is  not  geared  to  a 
specific  system  but  to  the  general  area  of  Interest  of  the  department. 

The  collection  of  much  data  normally  will  begin  long  before  a  spe¬ 
cific  project  is  undertaken.  This  is  necessary  because  a  prime  requisite 
to  cost  analysis  la  a  satisfactory  data  base.  It  is  important  to  have 
on  hand  as  much  historical  data  as  possible  not  only  on  "cost"  (or 
dollar)  data,  but  data  on  performance  specifications  and  design  charac¬ 
teristics  as  well.  Further,  these  data  must  be  analyzed  for  causal  fac¬ 
tors  so  that  we  can  use  these  historical  data  to  estimate  the  costs  of 
future  systems  based  on  the<r  assumed  characteristics.  We  must  start 
with  a  realistic  base  as  we  look  to  the  future. 
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Each  coat  analyst*  organisation  should  have  a  cost  library  (some¬ 
times  called  a  "Data  Bank")  which  would  provide  the  following:* 

(a)  A  means  for  Indexing  and  classifying  cost  and  related  data, 

(b)  A  physical  facility  for  the  storage  of  data. 

(c)  A  means  for  ready  access  to  the  data  by  the  analyst. 

In  sum,  an  adequate  data  base  occupies  a  critical  place  In  the 
cost  analysis  process.  Preparations  to  meet  data  requirements  must  be 
started  early,  and  data  must  be  maintained  continuously  to  be  available 
for  the  diverse  needs  of  cost  estimating. 

4 .  Converting  the  Information  Into  a  statement  of  resource  re¬ 
quirements  .  The  cost  analyst  takes  the  data  contained  In  the  system 
description  and,  armed  with  the  study  cost  ground  rules  and  assumptions, 
turns  to  his  cost  data  base  to  develop  estimates  of  the  resource  require¬ 
ments  In  terms  of  equipment,  facilities,  and  trained  personnel.  Dis¬ 
cussion  of  estimating  techniques  is  covered  in  general  terms  in  the 
next  topic,  "translating  the  resource  requirements  into  costs," 

Equipment  requirements  must  account  for  the  total  procurement  of 
units  including  not  only  the  basic  operational  units  but  those  set  aside 
for  testing,  for  use  by  training  organizations,  and  for  stockage  to  per¬ 
mit  maintenance  of  operational  units.  In  our  Illustrative  case,  we 
would  have  to  buy  not  only  the  more  obvious  operational  units  for  the 
10  schools,  but  also  sufficient  units  for  testing  during  the  R&D  phase, 
one  unit  for  training  the  equipment  operators  and  teachers  ,  and  the 
equivalent  of  several  units  to  replace  parts  as  they  fall. 

Facilities  should  Include  both  operational  and  support  facilities. 

For  our  sample  case  we  assumed  the  schools  would  be  located  in  a  metro¬ 
politan  area  so  support  facilities  would  not  be  required.  However,  if 
they  were  located  in  an  undeveloped  area,  it  might  be  necessary  to  pro¬ 
vide  additional  facilities  for  laundry,  fire  protection,  maintenance,  etc. 

Personnel  requirements  for  our  sample  case  would  probably  be  esti¬ 
mated  by  type  of  skill.  Teachers  would,  of  course,  be  a' critical 

*For  a  description  of  one  such  Data  Bank,  see  Slivlnski  [9]. 

"frit 

For  detailed  estimating  procedures  for  this  step  (oriented  to 
DOD  systems),  see  Large  [10],  especially  Chaps.  VIII,  XI,  and  XII. 
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resource  for  both  Systems  A  and  B.  Perhaps  aotne  categories  of  teachers 
would  become  a  very  critical  i  source  in  terms  of  a  limited  supply 
situation. 

5 ,  Translating  the  statement  of  resource  requlres>ents  into  costa. 
This  step  in  the  process  is  concerned  vith  the  actua’  calculation  of 
the  dollar  estimate.  Cost  estimates  are  developed  within  the  framework 
of  coat  element  lists.  Cost  elements  are  subdivisions  of  the  three 
cost  categories:  RAD ,  investment,  annual  operating.  All  costa  associ¬ 
ated  with  a  system  must  be  identified  and  Included;  hence,  availability 
of  a  good  cost  element  list  helps  to  attain  this  objective.  There  must 
be  flexibility  in  the  makeup  of  the  cost  element  list.  It  must  be 
adapted  to  the  type  of  system,  the  nature  of  the  problem,  and  the  type 
of  analysis.  However,  its  basic  function  is  to  identify  and  account 
for  all  elements  of  cost  associated  with  the  system.  The  ideal  cost 
element  list  highlights  the  key  features  of  the  system,  and,  at  the 
same  time,  permits  maximum  use  of  data  collected  from  past  systems.  The 
list  must  also  be  translatable  into  budgeting  and  programming  terms. 

A  cost  element  list  used  by  The  RAND  Corporation  for  its  studies 
of  an  I CBM  system  is  shown  on  the  right-hand  coluon  of  Fig.  8.  The 
figure  also  illustrates  the  major  system  description  information  and 
the  format  for  displaying  the  estimated  resources  required.  To  calcu¬ 
late  dollar  costs  for  each  cost  element  on  such  a  cost  element  list, 
the  cost  analyst  chooses  the  best  available  estimating  methods  from 
those  listed  below  (assuming  that  a  "Bill  of  Materials"  estimating  ap- 

it 

proach  is  not  used) . 

a.  A  catalog  price  .  An  item  to  be  costed  is  identified  as  an 
off-the-shelf  resource  and  the  appropriate  catalog  price  plus 
adjust  ment  is  used.  For  example,  most  of  the  equipment  in  the 
sample  System  B  was  assumed  to  be  off  the  shelf,  in  contrast 
to  tha  specialized  equipment  of  System  A.  Appropriate  quanti¬ 
ties  of  System  B  equipment  would  be  multiplied  by  the  prices 
in  dealer  catalogs. 

★ 

For  a  further  elaboration  on  estimating  methods,  see  AFSCL  173-1 
[11],  pp.  6-1  to  6-11. 


turn 


fi» 


II  «<*<«• 


lii>M«  or  t»vu»  coir 


-27- 


b.  A  specific  analog.  An  item  to  be  costed  Is  Identified  as  being 
analogous  to  some  specific  prior  system  and  costed  using  that 
system's  experience.  For  example,  Syatem  A  equipment  might 
conceivably  be  similar  to  that  used  by  System  Z  Installed  three 
years  ago  In  another  area. 

c.  An  estimating  relationship.  I  have  already  touched  on  esti¬ 
mating  relationships,  commonly  known  as  ERs  ,  without  formally 
defining  them.  An  ER  can  be  defined  as  a  mathematical  expres¬ 
sion  that  describes,  for  estimating  purposes,  the  cost  of  an 
item  or  activity  as  a  function  of  one  or  more  Independent  var¬ 
iables.  This  form  may  vary  from  simple  linear  relationships 
to  more  complex  forma.  For  example:  Cost  ■  a  +  bx  where 

X  is  an  independent  variable  and  a  and  b  are  parameters  whose 
values  are  to  be  determined  from  the  data.  When  a  is  equal 
to  aero,  the  estimating  relationship  has  the  typical  form  of 
a  Planning  Factor  such  as  $1000  per  man  or  $500  per  flying 
hour.  A  slightly  more  complicated  example  is: 


Depot  maintenance  coat  per  flying  hour  for  bombers: 
$  -  9.20  +  3.35X 


where  X  -  airframe  wt  in  thousands  of  lb. 

A  rather  complex  form  would  be: 

_  be 

Cost  -  ax  y  . 

An  example  of  this  form  la: 

irk 

Non-recurring  airframe  engineering  costs: 


$ 


14  S, 


0.54 


w0.88 


where  SR  * **  max  speed  In  kn 

W  -  airframe  wt  in  lb  . 


*Large  [l0],  p.  IV-24. 

**Hatry  [12],  p.  16. 
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I  will  not  attempt  In  this  paper  to  discuss  the  derivation  of 
ERa ,  but  th*  reader  la  referred  to  Large  [10],  Chapa.  IV  and  V. 

d.  An  expert  opinion.  An  expert  in  aome  functional  spec  laity 

(e.g.,  personnel)  or  field  of  technology  (e.g.,  salary  admin¬ 
istration,  computers)  provides  the  cost  estimator  with  an 
estimate  of  the  cost  of  the  Item  or  of  the  resources  In  the 
new  system. 

Learning  Curve.  As  a  final  remark  concerning  estimating  techniques, 
I  would  like  to  touch  on  the  learning  curve  .  The  learning  curve  or 
progress  curve  has  been  widely  used  In  the  aerospace  Industry  and  DOD 
as  a  technique  for  estimating  equipment  costs.  The  theory  of  the 
learning  curve  la  that  as  the  total  number  of  units  produced  doubles, 
learning  occurs  such  that  the  cost  per  unit  declines  by  some  constant 
percentage.  For  example,  an  80  percent  learning  curve  would  Indicate 
that  the  unit  cost  of  the  100th  unit  would  be  80  percent  of  the  unit 
cost  of  the  50th  unit,  and  so  on.  Mathematically,  this  Is  indicated  by 
the  expression,  cost  »  ax’  where  a  »  cost  of  the  first  unit,  x  *  the 
unit  whose  coat  la  desired,  and  b  -  the  slope  of  the  learning  curve. 

Figure  9  Indicates  a  typical  unit  cost  curve  and  Its  relation  to 
cumulative  average  costs  and  cumulative  total  costs.*  In  estimating 
advanced  systems,  the  cost  analyst  would  generally  first  derive  some 
point  on  such  a  curve,  such  as  the  cost  of  the  100th  unit  and  then  de¬ 
velop  a  learning  curve  for  the  system  (or  component). 

The  estimates  for  resources  and  dollars  for  Systems  A  and  B  might 
look  like  those  shown  on  Table  2.  For  illustrative  purposes,  I  have 
used  very  simple  estimating  relationships  for  all  cost  elements  in  the 
sample.  Perhaps  the  only  cost  element  needing  elaboration  Is  Replace  - 
ment  Training.  For  It  I  have  assumed  that  10  percent  of  the  teachers 
leave  System  A  each  year,  and  12.5  percent  leave  System  B.  These 
teachers  must  be  replaced  and  the  new  ones  mist  receive  the  special 
training  required  for  each  system. 

*For  an  excellent  sunnary  of  learning  curve  theory,  see  Brewer 

[14]. 


Fig. 9 — Progress  curves  resulting  from  the  assumption  of  a  linear 
unit  curve  on  logarithmic  grids 


Source:  Asher  [  13  ]  ,  p.23 
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Taole  2 

RESOURCE  REQUIREMENTS  AND  COST  ESTIMATES  FOR 
ALTERNATIVE  SYSTEMS  A  AND  B 
30,000  STUDENT  CAPACITY  SYSTEMS 

(Costs  In  mllllona  of  dollars) 


Resources 

ScKol  bulldlnga 

10 

15 

Sets  of  major  equipment: 

Teat-prototype 

_2 

-- 

Operations 

10  (specialized) 

15  (off-the-shelf) 

Training 

1 

1 

Spares 

4 

6 

Total  production  sets 

15 

22 

Personnel : 

Teachers 

500  (50  x  10) 

3000  (200  x  15) 

Cost  Estimates 

Research  and  Development: 

Engineering  development 

and  softvar,. 

100.0  (14  months 

1 .0  (16  months  0  .6) 

9  7.1) 

Prototype  fabrication 

30.0  (2  0  15) 

1.0  (off-the-shelf  +  mod.) 

Test  program 

20.0  (10  mos  0  2.0) 

8.0  (8  mos  0  1.0) 

Total  R6.D 

150.0 

10.0 

Investment : 

Buildings 

15.0  (10  0  1.5) 

15.0  (15  0  1.0) 

Equipment 

25.0  (15  0  1.7) 

15.0  (22  0  .7) 

Training  of  teachers 

5.0  (500  0  .01) 

24.0  (3000  0  .008) 

Supplies 

5.0  (10  0  .5) 

6.0  (15  0  .4) 

Total  Investment 

50.0 

60.0 

Annual  Operating: 

Building  maintenance 

1.5  (10X  of  lnv .) 

1  .5  (10Z  of  lnv.) 

Equipment  maintenance 

5.0  (20Z  of  lnv.) 

3.0  (20Z  of  lnv.) 

Suppl les 

3.0  (.3/school) 

7.5  (.5/school) 

Salaries  of  teachers 

5.0  (500  0  .01) 

30.0  (3000  0  .01) 

Replacement  training 

of  teachers 

_ .J_  (500  x  10Z  x  .01)1 

3.0  (3000  x  12. 5Z  x  .008) 

Total  annual  oper- 

atlng  (1  yr) 

15.0 

45.0 

Total  annual  oper- 

atlng  (10  yr) 

150.0 

<-50,0 

TOTAL  SYSTEM  COSTS 

(10  yr) 

350.0 

520.0 
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6.  Presenting  the  coat  estimates.  To  cover  thle  Important  «tep 
X  wleh  to  describe  three  aspects  of  how  the  coet  ansi  yet  coenunlcates 
with  the  users  of  his  estimates. 

(1)  The  presentation  form  must  be  appropriate  for  the  deci¬ 
sion  to  be  made. 

It  is  Important  that  the  analyst  find  ways  to  summer  1 ze 
and  to  distill  the  results  of  his  analysis  so  that  the 
user  can  quickly  grasp  the  essence  of  the  findings. 

Graphic  presentation,  summarizing  and  highlighting  the 
costs  in  meaningful  ways,  Is  highly  desirable,  with  only 
the  moat  essential  footnotes  or  "boiler  plate"  contained 
thereon.  Recall  Pigs.  1  and  2  of  the  sample,  how  they 
highlight  various  aspects  that  a  decisionmaker  would  want 
to  know. 

(2)  The  presentation  fora  also  must  be  translatable  Into  pro¬ 
gramming  and  budgetary  formats. 

In  addition  to  the  presentations  oriented  to  the  de¬ 
cision  to  be  made,  It  will  often  be  desirable  to  present 
findings  in  the  format  of  the  programming  system,  and 
possibly  of  the  budget  Itself  (although  one  should  caution 
that  these  are  not  budgetary  estimates  In  themselves). 
Therefore,  the  chart  of  cost  elements  developed  for  esti¬ 
mating  purposes  must  be  translatable  Into  more  standard¬ 
ized  financial  management  terms  ,  such  as  budget 
appropriations . 

(3)  The  sensitivity  of  the  costs  to  alternative  assumptions 
must  be  presented. 

A  review  of  the  estimates  by  cost  element  will  quickly 
Indicate  to  the  decisionmaker  the  areas  of  major  cost  sig¬ 
nificance  for  one  set  of  estimating  assumptions.  It  Is 
must  Important  that,  to  the  extent  possible,  the  cost  ana¬ 
lyst  present  charts  trfilch  Indicate  the  sensitivity  (and 
insensitivity)  of  costs  to  variations  In  the  study  assump¬ 
tions.  Three  fundamental  types  of  sensitivity  checks  will 
generally  be  applicable  to  the  results  of  most  cost- 
effectiveness  studies.  They  are: 
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.  Sensitivity  to  basic  system  or  project  requirements, 

.  Sensitivity  to  uncertainties  In  estimated  or  extrapolated 
data,  or 

.  Validity  of  simplifying  assumptions  or  arbitrarily  fixed 
variables.* 

An  exanqale  of  sensitivity  analysis  Is  presented  in  Novick  [1], 
pp.  115-119.  Figure  10,  borrowed  from  that  study.  Illustrates  a  sensi¬ 
tivity  analysis  of  a  low  altitude  penetrating  missile  launched  from  a 
long  endurance  aircraft  on  station  near  enemy  territory.  Total  system 
cost  Is  charted  as  a  function  of  three  variables:  force  size,  average 

flyout  distance  from  base  to  station  and  estimated  weight  of  the  mis¬ 
sile.  Total  system  cost  la  very  sensitive  to  the  missile  range  (and, 
hence,  gross  weight),  and  It  is  fairly  sensitive  to  whether  the  opti¬ 
mistic  or  conservative  estimate  of  the  weight  versus  range  curve  Is 
used.  On  the  other  hand,  total  system  cost  Is  relatively  Insensitive 
to  average  flyout  distance  from  base  to  station.  This  type  of  Informa¬ 
tion  can  guide  the  decisionmaker  in  making  decisions  about  allocation 
of  research  efforts  (to  reduce  missile  weight,  for  example)  and  opera¬ 
tional  deployment  considerations  (It  doesn't  cost  much  to  fly  longer 
distances,  allowing  the  use  of  bases  further  from  the  enemy). 

Toward  employing  sensitivity  analysis  to  our  school  sample,  let 
us  assume  that  there  Is  considerable  doubt  that  System  B's  team  concept 
can  be  made  so  efficiently  that  only  200  teachers  are  needed  per  school 
(a  10:1  student-teacher  ratio).  Assume  further  that  possibly  300 
teachers  or  even  400  will  actually  be  required.  These  assumptions  are 
considered  In  the  total  system  costs  which  are  displayed  on  Fig.  11. 
as  a  function  of  teachers  per  school.  In  this  figure  total  system  costs 
are  shown  to  be  quite  sensitive  to  the  number  of  teachers.  For  example, 
costs  for  30,000  students  rise  from  $520  million  to  $697  million  and 
$874  million  for  300  and  400  teachers  ,  respectively.  (Recall  that  dur¬ 
ing  our  discussion  of  sunk  costs,  system  B's  costs  were  relatively  In¬ 
sensitive  to  the  inheritance  of  facilities  from  System  C.)  Let  us  also 
assume  that  there  Is  a  possibility  that  the  teachers  required  for 

*WSE LAC  Final  Report  [16],  pp.  116. 


Total  system  cost  (billions  of  $ ) 


-33- 


R0  range  LAPM  # 

R|  rar.ge  LAPM  /  Conservative  LAPM 

/  /  *  weight  estimate 

//  . 

•  /  /  Optimistic  LAPM 

//  /  .  weight  estimate 

//  /  / 

//  /S  i  -  . 


//  /  / 

//  //  . 
////// 


Conservative  LAPM 
weight  estimate 

#  !  Optimistic  LAPM 

*  |  weight  estimate 


•  =  IjOO  n  mi  average  fly-out  distance  cases 

#  -■  3000  n  mi  average  fly-out  distance  cases 


Number  of  missiles  airborne  on  station 
Fig.  10 — Total  system  cost  versus  force  size  for  various  cases 

Source:  Novick  [  1  ]  ,  p.  1 1 8 
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System  A  could  double  Co  100  teachers  per  school  Instead  of  50.  In 
this  case,  system  costs  for  30,000  students  rise  from  $350  million  to 
$410  million. 

The  cost-benefit  curves  under  these  assumptions  are  plotted  on 
Fig.  12.  Cross-over  polnt9  for  varying  numbers  of  teachers  per  school 
nov  occur  as  follows: 

System  A 

Student  Capacity  Costs  (Mil.) 


System  B 

50* 

100* 

50* 

100 

200* 

13,600 

16,700 

242 

295 

300* 

8,600 

9,900 

207 

236 

400* 

6,400 

7,000 

193 

210 

*Teachers  per  school. 


System  B  Is  preferred  for  systems  whose  student  capacity  or  system  coat 
Is  equal  to  or  less  than  that  shown  In  the  above  table.  System  A  Is 
preferred  for  larger  values. 

How  trould  a  decisionmaker  use  this  Information  about  cost  sensi¬ 
tivity?  He  would  first  look  for  regions  where  one  system  was  clearly 
dominant.  In  our  example,  System  B  la  aOmlnant  in  all  cases  for  stu¬ 
dent  capacities  under  6400  and  for  system  cost  levels  under  $193  mil¬ 
lion.  System  A  Is  dominant  in  all  cases  for  student  capacities  over 
16,700  and  for  system  coat  levels  over  $295  million.  For  values  In  be¬ 
tween  these  points,  neither  system  is  dominant.  Selection  of  A  or  B 
la  Influenced  by  the  uncertainty  of  how  many  teachers  per  school  are 
needed.  Unfortunately,  we  Just  don't  know  what  the  decisionmaker  would, 
or  should,  do  In  this  situation.  His  selection  would  be  influenced  by 
such  factors  as  his  guess  as  to  the  likelihood  that  each  possible  num¬ 
ber  of  teachers  per  school  would  occur,  his  personal  value  systems,  his 
attitude  toward  risk-taking,  and  other  factors.  The  point  is,  however, 
that  because  we  have  this  region  of  uncertainty,  the  decisionmaker  will 
be  much  better  off  given  this  information  on  coat  sensitivity  than  If 
he  is  not.  Analysts  should  not ,  in  effect,  make  the  decision  themselves 
by  presenting  decisionmakers  with  only  one  set  of  possible  outcomes, 
instead  of  the  six  in  our  example 


Area  of  decision 
uncertainty 


B  =200 


f 


Student  capacity  (thousands) 

Fig. 12 — Sensitivity  analysis  —  system  costs  versus  number  of 
teachers  per  school  for  alternative  systems  A  and  B 
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7.  Documenting  the  Analysis.  A  proper  documentation  of  the  study 
Is  Important  to  both  the  cost  analyst  and  the  users  of  estimates.  Doc¬ 
umentation  Includes  not  only  the  published  estimates  and  their  deriva¬ 
tion  but  also  an  orderly,  cross-referenced  assembly  of  the  detailed 
working  papers  used  by  the  analyst  In  developing  the  estimates.  It 
provides  the  analyst  with  a  record  of  the  study  and  also  serves  as  a 
source  for  material  to  be  used  In  later  studies.  Studies  themselves 
serve  as  valuable  sources  of  data  for  Inclusion  In  the  data  bank. 

Documentation  Is  particularly  Important  to  the  user  of  the  cost 
estimate  In  his  evaluation  of  the  study.  Documentation  should  reflect 
the  analytical  approach.  It  should  openly  and  clearly  describe  the 
procedures,  data,  and  sources  used.  It  should  also  permit  the  estimates 
to  be  reproduced  by  following  the  process  and  facilitate  the  review  and 
evaluation  of  data,  sources,  Inputs,  and  methods.* 

The  DOD  Costing  Guidelines  contained  in  Appendix  1  contain  excel¬ 
lent  standards  for  documentation  of  cost- -benefi t  studies. 

I  strongly  believe  In  adequate  documentation.  To  do  this  success¬ 
fully  requires  a  great  deal  of  discipline  during  the  study  In  terms  of 
keeping  adequate  working  papers  and  notes  as  you  go.  It  Is  usually  too 
late  to  begin  good  documentation  when  a  study  Is  nearly  over  and  you 
are  under  pressure  to  write  the  final  report. 


VI.  TOTAL  PROGRAM  COST  ANALYSIS 

Up  to  this  point  we  have  been  discussing  the  analysis  of  Individual 
competing  systems  and  only  briefly  touched  on  total  program  costing 
when  discussing  Incremental  costs.  I  will  now  subdivide  these  two  types 
of  cost-benefit  studies  as  follows  (In  ascending  order  of  aggregation) : 


For  an  Interesting  set  of  questions  suggested  for  a  reviewer  of 
a  study  to  ask  regarding  costs,  see  I.  Heymont,  et  al .  ,  [15 J. 

For  a  further  discussion  oriented  to  the  DOD,  see  H.  P.  Hatry, 

[12]. 
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Study  Type _ 

System 

Intra-ays terns 


Inter -a ye  terns 


Example 


Comparison  of  alternative  configura- 
Clona  of  System  A 

Comparlaon  of  alternative  syatema  A, 
B,  C  for  high  achool  dropout  training 


Program 

Major  program  Comparlaon  of  alternative  comblnatlona 

of  ayatema  of  the  Job  Placement  Train¬ 
ing  Program 

Total  agency  Comparlaon  of  alternative  comblnatlona 

of  major  programa  which  comprlae  the 
total  program  of  Health,  Education  and 
Welfare  Department 


I  will  only  briefly  dlacuaa  the  two  typea  of  system  atudiea,  but  go 
Into  more  detail  about  the  two  typea  of  Program  Studlea. 

1.  Inter -ayatema  Analyala.  To  thla  point  all  our  material  was 
oriented  to  the  comparison  of  alternative  ayatema.  We  observed  that 
coata  and  benefits  are  related  in  the  analytical  approach;  we  identi¬ 
fied  the  salient  features  of  estimating  system  costs,  and  the  steps  In¬ 
volved  In  preparing  the  estimates. 

2.  Intra-ayatems  Analyala.  The  examination  of  alternative  con¬ 
figurations  of  a  single  system  la  often  referred  to  as  trade -off 
analysis .  The  objective  is  to  trade -off  time,  cost,  and  performance 
to  find  the  optimum  combinations  under  various  assumptions.  Except 
for  the  focus  on  alternative  configurations  of  a  single  system,  rather 
than  competing  ayatema,  the  estimating  procedure  Is  Identical  to  that 
of  Inter -systems  analysis.  Applying  lntra-aystem  analysis  to  our  school 
sample  we  might  examine  the  man-machine  relationships  within  System  A 

to  find  the  optimum  combination  of  teachers  to  computers  and  related 
* 

equipment . 

3.  Major  Program  Studies.  The  combination  of  ayatema  Into  i 
Program  or  Major  Mission  Area  is  a  significant  feature  of  PPBS.  The 

*Por  detailed  specifications  and  procedures  regarding  trade-off 
analyala  for  DOD  ayatema,  see  APSOl  375-5,  [6], 
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analysls  and  selection  of  the  systems  which  comprise  the  program  may 
be  viewed  as  a  two-step  procedure.  In  the  first  step  Individual  sys¬ 
tems  are  analyzed  In  order  to  gain  an  understanding  of  their  capabil¬ 
ities,  costs,  and  limitations.  In  the  second  step  the  more  Interesting 
candidate  systems  are  analyzed  In  the  context  of  the  total  program  and 
Its  objectives.  A  total  program  la  thus  fomilated. 

The  DOD  Program  I,  Strategic  Forces,  Is  an  example  where  program 
analysis  has  attained  a  rather  sophisticated  state.  The  offensive 
forces  (our  bombers  and  missiles)  are  balanced  against  our  bomber  and 
missile  defensive  forces  plus  a  Civil  Defense  program  to  meet  specified 
levels  of  Assured  Destruction  to  our  enemies  and  of  Damage  Limiting 
(to  the  U.S.).  Decisions  on  Individual  strategic  systems  are  difficult, 
If  not  impossible j  to  make  outside  this  total  program  context.  In  our 

Illustrative  case J  the  systems  we  examined  for  training  high  school 

\ 

dropouts  similarly  must  be  further  analyzed  In  a  total  program  context 
before  a  final  decision  on  them  can  be  made.  For  example,  a  balance 
must  be  drawn  between  the  type  of  training  provided  by  Systems  A,  B, 
and  C  and  other  types  of  training  programs . 

4.  Total  Agency  Studies.  The  development  of  a  balanced  grouping 
of  major  programs  Into  a  total  for  an  agency  Is  a  most  difficult  task. 

It  may  not  even  be  a  meaningful  task,  as  concerns  the  balancing  of  ben¬ 
efits,  for  agencies  having  a  wide  variety  of  objectives  to  accomplish. 

Cn  the  cost  side,  however,  it  Is  often  very  meaningful  to  prepare  cost 
estimates  of  total  agency  programs.  This  Is  most  useful,  even  required, 
for  budgeting  and  programing  purposes  so  that  the  total  resource  and 
dollar  requirements  of  the  agency  can  be  determined.  When  costing  mil¬ 
itary  systems,  we  refer  to  this  type  of  study  as  a  Total  Force  Structure 
Study.  A  typical  format  for  displaying  total  force  structure  costs  (for 
the  Air  Force)  la  shown  In  Fig.  13. 

Since  major  program  and  total  agency  study  cost  analysis  techniques 
are  too  Involved  for  detailed  coverage  here,  I  will  mention  only  a  few 
of  their  key  features: 


Figure  13 


Or  other  appropriate  unit. 

*Hay  be  broken  down  Into  aub-categorlea — e.g.,  USAF  Budget  Codes  or  some  other 
coat  element  structure. 
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1.  Emphasis  on  Incremental  costs  (all  operational  systems 
are  specified) . 

2.  Emphasis  on  total  program  costs  (all  support  elements 
are  specified) . 

3.  Emphasis  on  annual  costs  over  a  long  time  period. 

4.  Stress  on  a  Base  Case  to  measure  incremental  costs  of 
alternative  forces. 

3.  Presentation  of  forces,  resources,  and  costs  by  program 
and  program  element. 

6.  Utilization  of  a  computer  model  Is  essential  for  rapid, 
consistent  costings. 

(1)  Emphasis  Is  placed  on  Incremental  costs.*  Recall  that 
even  when  conducting  a  cost  analysis  of  Individual  systems,  we  are 
always  Implicitly  costing  the  systems  In  a  total  program  or  agency 
context.  Assumptions  are  made  regarding  the  Inheritance  from 
other  systems  of  trained  personnel,  facilities,  and  equipment. 

Total  program  cost  analysis  provides  an  explicit  approach  for 
Incremental  costing  by  establishing  a  framework  within  which  all 
the  resources  available  and  the  needs  of  all  the  systems  can  be 
considered  simultaneously  at  successive  Intervals  of  time.  This 
Is  done  by  specifying  all  of  the  systems  which  will  be  operational 
In  the  force  and  noting  those  resources  freed  by  system  phase-outs 
and  those  required  by  system  phase-ins. 

(2)  Emphasis  Is  placed  on  Total  Program  Costs.  An  explicit 
effort  Is  made  to  specify  and  cost  all  program  elements,  and  es¬ 
pecially  the  support  elements,  which  comprise  a  Total  Program. 

Some  of  these  elements  will  vary  with  the  number  and  the  activity 
level  of  the  direct  systems,  while  others  will  be  relatively  Inde¬ 
pendent  of  them.  For  example,  In  attempting  to  specify  a  Job 
Placement  Training  Program,  the  administrative  headquarters  of  the 
area  Job  Placement  Training  Divector  would  be  Included.  In  costing 
a  total  agency,  the  Washington  he  dquarters  of  HEW  would  be  In¬ 
cluded.  In  sum,  the  objective  Is  to  specify  all  elements  In  a 
Total  Program. 


For  further  discussion,  see  Novlck,  [18],  pp.  60-63, 
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(3)  Emphasis  la  placed  on  annual  costs  over  a  long  time 
period.  The  tine  horizon  la  very  Important.  Long-range  planning 
la  atlll  the  objective,  and  programa  5,  10,  or  15  yeara  ahead  are 
Involved,  A  key  Idea  to  note  la  that  the  syatema  must  be  projec¬ 
ted  aeveral  yeara  beyond  the  dealred  analytical  cutoff  date  In 
order  to  take  Into  account  long-lead-time  ltema.  If  approved  sys¬ 
tems  are  not  projected  In  this  manner,  then  a  characteristic 
talllng-off  of  coats  will  appear  which  may  be  misleading.  This 
effect  la  shown  In  Fig.  14.  The  DOD  Five-Year  Defense  Plan  de¬ 
picts  military  forces  for  8  years  and  costs  for  5  years.  Of  course 
aome  talllng-off  alwaya  occurs  aa  old  systems  phase  out  If  new 
ones  are  not  proJected--but  this  knowledge  la  desirable  In  plan¬ 
ning  alternative  defense  programs.  In  fact,  one  of  the  values  of 
the  Five-Year  Defense  Plan  la  that  It  alwaya  depicts  the  spendout 
costa--that  la,  the  coats  of  the  military  forces  If  no  further 
changes  were  to  be  approved . 

(4)  Emphasis  la  placed  cn  a  Base  Case  for  purposes  of  measur¬ 
ing  the  Incremental  coats  of  alternative  forces.  We  are  generally 
Interested  in  looking  at  a  number  of  alternative  programs  rather 
than  Just  one,  and  In  measuring  the  Incremental  cost  of  each  al¬ 
ternative  In  relation  to  some  base  case.  The  base  case  Is  often 
the  currently  approved  program,  although  It  could  be  any  postu¬ 
lated  program  from  which  variations  are  considered. 

There  la  an  Important,  though  perhaps  subtle,  point  to  be  made 
In  connection  with  costing  the  approved  program  to  serve  as  a  base 
case.  The  point  la  that,  In  DOD,  for  example,  the  approved  pro¬ 
gram  la  already  costed  in  the  Five-Year  Defense  Plan.  However, 
this  costing  was  done  for  a  different  purpose --that  of  programming . 
Therefr  s,  al ternatlvee  cos  ted  by  other  methods,  such  aa  those  used 
In  planning  studies,  cannot  be  directly  compared  with  the  Five  - 
Year  Defense  Plan  Coats.  The  observation  is  not  intended  to  be 
critical.  Rather,  I  merely  wish  to  point  out  the  nature  of  the 
process,  wherein  literally  hundreds  of  staff  personnel  are  in¬ 
volved  in  costing  the  Five-Year  Defense  Plan.  Currently,  Judgment 
rather  than  consistent  ERs  Is  used  In  estimating.  Estimates  are 


T  years 


p"  T  +  3  years  " 

Fiscal  year 

Fig.  14 — Extending  the  period  of  analysis 
Source:  Novick,  [  1 8 p.66 
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tampared  by  administrative  budgetary  ceilings  (these  ceilings 
are  even  projected  for  several  years  ahead);  In  general,  the  re¬ 
sults  are  just  not  reproducible  In  the  scientific  sense  of  the 
word . 

To  obtain  reasonable  estimates  of  the  Incremental  costs  for 
alternative  programs  It  la  mandatory  that  the  systems  In  the  ap¬ 
proved  program  be  costed  by  a  methodology  consistent  with  that 
usad  to  cost  the  alternatives.  Ihls  base  case  can  then  be  used 
to  measure  dl f ferences  from  the  approved  program.  It  can  then  be 
assumed  that  the  differences  are  additive  to  the  approved  Five- 
Year  Plan  costs. 

(5)  Forces,  Resources,  and  Costs  are  displayed  by  Program 
and  Program  Element.  As  previously  noted,  a  typical  display, 

(for  the  Air  Force)  is  shown  In  Fig.  13. 

(6)  Use  of  a  computer  model  Is  essential  for  rapid,  consistent 
costings.*  A  computerized  model  Is  essential  for  timely  analysis 
of  programs  on  any  suitable  basis.  By  computerized  model  I  mean 
more  than  Just  a  set  of  computer  program  instructions--!  refer 
also  to  a  trained  analytical  staff  who  develop  and  supply  appro¬ 
priate  factors  to  the  computer  program.  The  objective  Is  to  cost 
the  alternative  forces  both  rapidly  and  consistently  In  order  that 
comparisons  can  be  made  to  determine  incremental  costs. 

Time -phasing .  The  final  topic  _o  be  covered  Is  the  time-phasing 
of  cost  estimates.  Tine-phasing  (the  annual  incidence  of  costs)  is 
essential  for  program  costing,  for  individual  system  costing  where  dis¬ 
counting  to  a  present  value  is  to  be  done,  and  for  many  other  indi¬ 
vidual  system  costings  for  the  reasons  listed  below: 

First,  the  Impact  by  fiscal  year  by  funding  category  is  important 
because  of  possible  budgetary  ceilings  either  on  total  agency  budgets 
or  on  pockets  of  funds,  such  as  mllicary  construction.  Two  particular 
measures  of  financial  impact  of  interest  are  those  of  Total  Obligatlonal 


For  further  descriptions  of  some  models  and  related  analytical 
activity,  see  Novick  [18],  Chap.  Ill;  Grosse  [19],  and  String  [20], 
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Authorlty  (TOA)  and  Expend!  tures  ■  TOA  consists  of  new  obilgatlonai 
authority  (the  authority  to  Incur  obligations  to  pay)  asked  of  Congress 
plus  obllgatlonal  authority  carried  over  from  prior  years  which  Is 
available  for  funding  new  programs,  plus  reimbursements  for  certain 
Items.  The  DOD  Five-year  Program  Is  displayed  In  TOA  terms.  The  TOA 
totals  are  converted  Into  Expenditures  ,  payments  of  money  from  the 
Treasury.  Both  measures  are  Important,  TOA  to  predict  requests  for 
funds  to  Congress  and  Expenditures  to  predict  the  Impact  of  the  national 
cash  flow. 

Figure  15  depicts  a  timing  relationship  between  TOA  and 
Expenditures. 


Fig.  15  —  Timing  of  T.O.A.  and  expenditures 
Source:  Novick,  [  18  ]  ,  p.  66 
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Second,  time-phasing  provides  a  better  visibility  Into  the  matter 
of  Inheritable  assets,  which,  es  we  have  noted  before,  Is  an  essential 
component  In  the  calculation  of  the  incremental  cost  of  a  system. 

Being  explicit  about  the  time -phasing  helps  to  Improve  the  estimates 
of  Inheritable  assets,  although  this  technique  alone  is  not  as  Impor¬ 
tant  as  that  of  explicitly  costing  the  total  program,  t^us  taking  Into 
account  all  systems  which  could  provide  inheritable  assets.  Figure  16 
compares  time-phased  costa  with  the  system  cost  categories. 

Third,  It  shova  In  annual  Increments  what  is  needed  to  phase  from 
the  current  program  to  a  recomnended  program  and  brings  to  light  the 
produclblllty ,  financial,  personnel,  etc.,  aspects  of  the  plan. 

Methods  for  time-phasing  estimates  depend  on  the  problem  at  hand 
and  on  the  available  information.  One  technique  for  making  rough  es¬ 
timates  of  systems  in  a  conceptual  stage  is  called  the  Percentage -Time 
Percentage -Cost  (PTPC)  technique.  Figure  17  illustrates  the  technique. 
It  ehovs  the  dollar  ccats  (right-hand  scale)  and  the  estimated  actual 
time  corresponding  to  the  percentages  (left-hand  scale).  The  conven¬ 
tional  technique  foi  estimating  the  time  phasing  of  costs  for  those 
systems  having  more  information  available  involves  the  development  of 
time -phased  product ion  schedules,  such  as  that  shown  in  Fig.  18,  for 
each  resource  and  the  application  of  appropriate  funding  lead  or  lag 
times.  For  example,  aircraft  production  may  require  a  24-oonth  lead 
time  to  estimate  iOA  pertaining  to  the  first  production  lot,  and,  say, 
an  18-month  lead  time  thereafter. 

I  wish  to  close  this  topic  with  a  r.ote  of  caution.  The  llms- 
phasing  of  a  total  estimate  generates  many  seemingly  precise  numbers. 

Do  not  confuse  this  precision  with  accuracy'.  The  uncertainty  surround¬ 
ing  the  original  estimate  is  not  changed  by  presenting  it  as  a  series 
of  annual  estimates. 

*See  AFSCL  173-1  [ll],  pp.  7-4  to  7-13. 
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Fig.  16  —  System  costs  time-phasing  (by  fiscal  years) 


Source:  Large  [loj  ,  p.  111-11 
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CONCUJDINC  RZMASXS 

In  this  discussion,  I  have  attempted  to  review  the  concepts, 
prlnclplea,  and  the  general  approach  of  system a  coat  analyala  In  aup- 
port  of  coat-benefit  atudlea.  The  role  of  coata  vaa  conaldered  both 
In  Individual  ayatem  analyala  and  within  the  broader  context  of  program 
analyala.  This  description  of  reaource  analyala  waa  intended  primarily 
for  the  uaera  of  cost  estimates,  as  opposed  to  coat  analysts.  Users 
of  cost  estimates  must  face  the  critical  task  of  judging  cost  estimates 
and  evaluating  their  suitability  and  quality.  The  intent  of  this  dis¬ 
cussion  was  to  Improve  the  ability  of  those  Involved  In  the  conduct  of 
cost-benefit  studies  In  non-defense  agencies  to  appreciate  the  role  of 
coating,  to  understand  the  limitations  of  cost  analysis,  and  to  estab¬ 
lish  adequate  guidelines  for  the  costing  work  done  In  support  of  these 
atudlea. 
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COSTING  GUIDELINES 
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DEPARTMENT  OF  DEFENSE  COST-EFFECTIVENESS  STUDIES 


May  1 ,  1966 

Office  of  Che  Assistant  Secretary  of  Defense  (SA) 
Resource  Analysis 
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INTRODUCTION 


Coat  estimates  have  become  an  integral  part  of  the  submission  of 
weapon  systems  studies  and  proposals  within  the  Department  of  Defense. 
These  estimated  costs  are  scrutinized  at  each  stage  of  review  of  the 
study  or  proposal.  In  an  effort  to  establish  a  standard  for  preparing 
and  presenting  such  estimates,  and  to  achieve  greater  consistency  and 
comparability  among  cost  studies,  these  guidelines  have  been  published. 

A  set  of  general  costing  guidelines  is  presented  to  88818*:  study 
teams  in  fulfilling  cost  requirements.  Additional  ad  hoc  ground  rules, 
based  on  the  unique  characteristics  of  a  particular  study,  will  normally 
also  be  required.  Military  departments  are  encouraged  to  prepare  such 
ground  rules  on  their  own  Internal  studlet.  Costing  for  studies  being 
prepared  for  OSD  should  normally  be  compatible  with  the  guidelines  con* 
talned  herein. 

This  set  of  guidelines  is  a  modification  of  a  version  prepared  for 
inclusion  in  the  "Department  of  Defense  Guide  for  Contract  Definition," 
currently  in  preparation.  These  guidelines  are,  therefore,  written  to 
apply  to  a  wide  range  of  cost-effectiveness  studies. 


-53- 


COSTING  GUIDELINES  FOR  POD  COST-EFFECTIVENESS  STUDIES 


It  is  difficult  to  prescribe  very  specific  costing  rules  which  spply 
across  the  board  to  all  Department  of  Defense  cost-effectiveness  studies. 
Each  study  will  have  its  own  objectives,  problems,  and  emphasis.  The 
following  costing  guidance,  therefore,  is  necessarily  somewhat  general. 

The  Military  Departments  during  the  initial  stages  of  a  study,  using 
these  guidelines  as  a  starting  point,  should  prepare  as  appropriate  a 
more  specific  set  of  costing  guidelines  based  upon  the  specific  objec¬ 
tives  of  the  study  at  hand. 

Should  specific  questions  arise  concerning  study  costing  practices,  the 
OASD(SA) ,  Resource  Analysis  Office,  is  available  to  the  Military  Depart¬ 
ments  for  consultation.  Military  Department  contractors  should  direct 
their  questions  to  the  Military  Departnmnt's  Project  Manager. 

It  is  to  be  noted  that  the  Costing  Guidelines  and  discussion  in  this 
paper  are  not  for  the  purpose  of  providing  guidance  for  the  preparation 
of  contractor  hardware  proposal  estimates.  Contractor  hardware  pro¬ 
posal  estimates  will  typically  require  considerably  more  detail;  such 
estimates,  however,  should  be  compatible  with  the  costs  used  by  the  con¬ 
tractor  in  his  cost-effectiveness  studies. 

1.  All  significant  costa  that  might  affect  the  choice  of  alterna¬ 
tives  should  be  Included  in  the  analysis.  All  phases  of  the  life  cycle 
of  a  system  should  be  considered  for  inclusion- -development ,  Investment, 
and  operating  costs.  Normally,  studies  will  need  to  Include  costs  for 
all  three  phases  to  make  certain  that  the  complete  costs  impacts  are 
presented. 

Emphasis  should  be  placed  on  identification  of  those  costs  which 
differ  among  the  various  alternatives  being  considered.  Costs  which 
are  expected  to  be  the  same  for  all  alternatives  considered  in  the  study, 
(such  as  Service  headquarters'  staffs  or  certain  base  operating  costs), 
even  though  these  costs  are  required  during  the  time  period  examined 
in  the  study,  may  be  excluded.  (However,  there  may  be  Instances  where 
it  is  desirable  to  consider  total  costs,  including  these  other  costs.) 
Where  more  than  one  Military  Department  or  contractor  is  undertaking  a 
study,  the  danger  arises  that  one  and  not  the  other  may  exclude  certain 
costs.  Where  such  possibilities  can  be  anticipated,  the  Military 
Departments  should  provide  advanced  guidelines  which  resolve  this  prob¬ 
lem.  The  results  of  the  studies  would  otherwise  not  be  truly  comparable 
until  adjustments  were  made  for  the  differences. 

2.  Indirect  and  supporting  costs  (such  as  base  operating  support, 
combat  aupport  unit*,  tanker  support  for  an  aircraft  force,  supply  ship 
or  tender  support  fr r  a  force  of  ships,  special  training  or  testing  re¬ 
quirements,  etc.)  should  be  considered  a  part  of  the  total  system  cost 
and  should  be  Included,  as  appropriate  to  the  study. 
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3.  "Sunk"  coats  (i.a.,  coata  which  can  reasonably  be  assumed  to 
have  been  expended  prior  to  the  beginning  of  the  tine  period  examined 
In  the  study)  are  not  relevant  and  should  be  excluded.  (However,  on 
occasion  the  display  of  certain  sunk  coats  may  be  desirable  for  refer¬ 
ence  purposes,  e.g.,  to  specify  which  costs  have  been  excluded  from  the 
study.) 

4.  In  order  to  permit  proper  evaluation  and  understanding  of  the 
work,  each  study  should  be  fully  documented  as  to  the  source,  techniques, 
cost-estimating  relationships  and  assumptions  used  to  develop  the  costs. 
This  Is  especially  Important  for  the  new  systems  which  are  being  evalu¬ 
ated  and  are  not  currently  included  in  the  Department  of  Defense  ap¬ 
proved  Five-Year  Force  Structure  and  Financial  plan.  Where  different 
contractors  are  performing  parallel  CD?  studies,  It  is  also  necessary 

to  be  able  to  Identify  any  major  differences  In  costing  assumptions 
among  the  contractors.  Preferably,  an  Individual  cost  "factor"  sheet 
should  be  provided  on  each  system  considered  In  the  analysis.  The 
sheet  would  surn&arize  the  cost  and  planning  factors  utilized  In  the 
study  In  such  a  manner  that  an  outside  analyst  could  reconstruct  the 
sutmary  costs  presented  In  the  study.  An  example  of  such  a  format  Is 
provided  in  Exhibit  1.  It  should  be  noted  that  the  cost  backup  should 
be  presented  on  a  "per  force  unit"  or  "per  force  unit-year"  basis  to 
facilitate  review  of  the  cost  details.  Where  a  force  unit  consists  of 
major  procurement  Items  or  other  cost  elements  for  which  cost-quantity 
(learning)  curves  are  used  In  cost  estimation,  the  Individual  curves 
should  be  provided.  Since  the  "unit"  cost  will  then  vary  with  the  total 
quantity,  "per  force  unit"  costs  need  not  be  provided  for  such  cost  el¬ 
ements.  Where  Military  Department  cost  models,  program  factors,  or 
other  widely  distributed  compilations  of  cost  data,  are  used  to  esti¬ 
mate  coats,  a  simple  reference  to  those  publications  is  sufficient. 

For  significantly  new  or  sophisticated  systems,  and  those  not  currently 
included  In  the  DOD  approved  list,  adequate  cost-supporting  data  should 
be  included.  The  major  cost -determining  characteristics  of  the  system 
as  noted  In  (5)  below  should  be  included  in  the  study  submission. 

5.  Each  alternative  system  and  major  hardware  Item  should  be 
clearly  described  as  to  Its  major  cost  generating  characteristics  used 
In  the  study.  For  example,  the  following  characteristics  should  be 
identified  where  pertinent  to  the  derivation  of  the  cost  estimates. 

.  Hardware  operational  perfornwnce  characteristics  such  as  accu¬ 
racy,  speed,  and  resolution. 

-  Major  design  characteristics,  such  as  weights,  size,  and  specific 
impulse . 

-  System  operating  concepts  such  as  aircraf t/misslle  bass  disper¬ 
sion  assumptions,  tanker -to -bomber  ratios,  tender-to-SSBN  ratios, 
number  of  missiles  carried  per  aircraft,  number  of  maneuver 
battalions  per  division  base,  etc. 

4.  In  addition,  "planning"  factors  such  as  the  following,  where 
used  to  derive  the  total  cost  figures,  should  be  Identified: 
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-  Activity  levels  such  aa  the  flying  houra  per  aircraft  per  year. 

-  "UE  ahlpflll,  or  baalc  load  quantity  per  force  unit. 

-  Annual  teat  or  training  consumption  factors. 

-  Aircraft  attrition  rates. 

-  Pipeline  and  spares  factors. 

6.  Coats  for  cost-effectlveneaa  studies  normally  should  be  stated 
In  constant  dollars  of  the  latest  year  available.  Tha t  la,  projected 
price  level  changes  should  be  excluded.  This  is  a  standard  practice 
which  has  the  advantage  of  avoiding  tha  necessity  for  predicting  price 
level  changes  and,  If  not  otherwise  required,  avoids  the  necessity  for 
time  phasing  the  costs  by  year  (which  is  required  when  applying  pro¬ 
jected  price  level  Indices).  Hovrever ,  special  occasions  may  arise  when 
It  may  be  necessary  or  preferable  to  Include  projected  price  level 
changes  In  certain  of  the  estimates.  In  such  cases,  the  price  change 
assumptions  should  be  clearly  stated  and  the  magnitude  of  such  changes 
Indicated . 


7.  In  order  to  achieve  consistency  and  comparability  among  DGD 
cost  studies,  the  cost  element  categories  and  data  used  In  the  study 
should  be,  as  far  as  possible,  compatible  with  the  latest  information 
from  official  Military  Department  sources.  At  present,  the  suggested 
sources  are:  Air  Force  Cost  Division  (AFABF)  ,  Army  Cost  Analysis 
Directorate  (Army  Comptroller)  ,  and  Navy  -  Program  Appraisal  Division 
(CNC-OP90).  The  data  available  from  these  sources  are  not  likely,  how¬ 
ever,  to  be  completely  satisfactory  where  detail  at  the  subsystem 
level  Is  required.  However,  use  of  the  latest  official  Military  Depart¬ 
ment  cost  and  planning  factors  manuals,  available  through  these  offices, 
to  the  extent  that  they  are  applicable,  will  save  considerable  time, 
effort,  and  the  need  for  substantiation.  It  is  not  Intended,  however, 
to  restrict  study  teams  to  these  factors.  It  Is  recognized  that  a  study 
team  may  not  be  able  to  use  this  data  or  may  disagree  with,  or  at  least 
prefer  to  use,  Information  at  variance  w  th  these  sources.  This  Is 
permissible,  but  the  reasons  should  be  provided. 

8.  The  exact  quantity  of  any  proposed  hardware  that  would  eventu¬ 
ally  be  procured  can  seldom  be  completely  resolved  at  the  time  of  the 
cost-effectiveness  study.  It  Is,  therefore,  desirable  that  the  cost 
Information  supplied  permit  estimation  of  costs  at  various  quantities 
within  a  reasonable  range  of  possibility,  as  excursions  from  the  cases 
directly  examined  In  the  study.  Procurement  cost  versus  quantity  rela¬ 
tionships  (expressed,  for  example,  as  equations  or  cos t -quant! ty  curves) 
should,  therefore,  normally  be  provided.  These  should  be  provided  for 
each  major  procurement  Item.  This  might  mean  a  complete  system  such 

as  a  complete  aircraft  or  missile,  or  where  appropriate  to  the  study, 
a  subsystem  such  as  a  particular  avionics  package,  the  propulsion  sys¬ 
tem,  airframe,  etc.  In  addition,  the  effect  of  quantity,  If  any,  upon 
development  and  annual  operating  costs  should  be  indicated.  These  re¬ 
lationships  should,  to  the  extent  possible,  take  proper  cognizance  of 
the  recurring  versus  non-recurring  costs.  That  Is,  recurring  costs 
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(such  as  recurring  tooling  for  aircraft  airframes)  should  be  dlstlng jlshed 
from  th<  .on-recurrlng  coat*  (auch  aa  airframe  Initial  tooling).  If 
the  rata  of  production  (aa  veil  aa  the  total  production  quantity)  la 
alao  a  algnlflcant  coat  Influencing  variable  for  the  major  procurement 
ltama,  the  appropriate  coat  lmpllcatlona  of  major  production  ra  >  changea 
ahuuld  be  indicated. 

9.  The  level  of  detail  to  which  ayatema  ahould  be  broken  down  and 
for  which  coata  are  to  be  dlaplayed  depend*  upon  the  nature  and  depth 
of  the  Individual  atudy.  The  originator  of  the  atudy  ahould  apeclfy 
In  advance  the  level  of  detail  needed.  Hore  detail  will  normally  be 
required  for  CDP  than  for  earlier  atage  "Concept  Formulation"  atudlea. 

10.  The  major  uncertainties  in  the  coat  eatlmatea  ahould  be  Identi¬ 
fied.  To  the  extent  posalble,  theae  uncertainties  ahould  be  quantified 
(even  if  only  aubjactlvely)  aa  to  the  magnitude  and  the  likelihood  of 
the  uncertainty.  This  might  be  done,  for  example,  by  providing  esti- 
matea  of  the  range  and  "moat  likely"  valuea  or  by  providing  an  estimated 
"probability  dlatr lbution"  on  the  coat  eatlmatea  for  each  major  alter¬ 
native.  For  major  coat  uncertainties,  the  sensitivity  of  the  study  re¬ 
sults  to  these  uncertainties  ahould  be  Indicated;  In  other  words, 
"sensitivity  analysis"  ahould  be  performed  whenever  feasible.  Major 
cost  uncertainties  may  be  caused  by  assumptions  pertaining  to  system 
characteristics  (auch  aa  those  listed  In  (5)  above)  aa  well  as  to  spe¬ 
cific  cost  factors. 

11.  A  number  of  possible  coat  measures  have  been  suggested  at  ene 
time  or  other  for  cost-effectiveness  atudlea.  The  major  one*  of  Inter¬ 
est  are: 


a.  The  sum  of  development  plus  Investment  plus  some  speci¬ 
fied  number  of  years  (conmonly  from  five  to  ten)  of  level-off 
annual  operating  costs.  Operating  costs  Incurred  during  periods 
of  buildup  or  phase -down  are  Ignored. 

b.  Annual  costs  over  some  specified  period.  That  Is,  the 
costs  for  each  alternative  are  time  phased  thereby  permitting 
examination  of  each  year's  funding  requirements. 

c.  Cumulative  actual  costs  over  some  specified  number  of 

years . 

In  addition,  on  occasion,  analysts  have  further  modified  each  of 
these  cost  measures  by  one  or  both  of  the  following  adjustments: 

a.  Application  of  "discount"  rates  to  the  estimated  costs 
for  each  year.  The  discount  rate  attempts  to  consider  the 
time  value  of  money.  It  Is  similar  to  an  Interest  rate  in  In¬ 
dicating  that  current  dollars,  because  of  their  ability  to 
earn  compounded  interest  dollars,  are  more  valuable  now  than 
dollars  which  are  available  later  In  the  future.  The  annual 
dlscountad  costs  for  each  alternative  caa  be  sunned  to  give  a 
"present  worth"  of  the  costs  of  each  alternative. 


-57- 


b.  Adjuatmant  of  the  cotta  for  an  estimated  "residual 
value"  of  each  alternative.  Wher'  systems  being  compared  have 
significantly  different  expected  lifetimes,  consideration  In 
the  study  of  a  relatively  short  time  period  may  not  otherwise 
consider  the  potential  Investment  savings  possible  in  a  sub¬ 
sequent  time  period  from  having  procu-ed  the  longer  lived  sys¬ 
tems.  The  residual  value  adjustment  (analogous  to  "scrap 
values"  in  equipment  replacement  studies)  attempts  to  repre¬ 
sent  the  economic  value  of  any  life  expectancy  remaining  at 
the  end  of  the  period  of  the  study. 

It  is  difficult  to  pre-specify  exactly  which  cost  measure  should 
be  used  in  a  study.  However,  the  following  general  statements  reflect 
the  present  thinking. 

a.  In  all  cases,  figures  which  reflect  the  estimates  of  full 
costs,  without  such  adjustments  as  discounting  and  residual  values, 
should  be  provided  in  the  study. 

b.  Studies  may  also  display  these  costs  discounted  and/or 
adjusted  for  residual  value  if  the  analysts  believe  this  is  appropri¬ 
ate  to  the  situation.  If  residual  values  are  utilized,  such  values 
should  be  identified.  A  display  of  the  sensitivity  of  the  study  con¬ 
clusions  to  these  considerations  is  appropriate.  Where  preliminary 
indications  suggest  that  similar  funding  patterns  and  similar  system 
lifetimes  are  involved  among  the  systems  being  compared,  it  is  pref¬ 
erable  to  avoid  the  additional  effort  and  possible  confusion  required 
in  making  the  discounting  and/or  residual  value  analyses.  Where  dis¬ 
counting  or  residual  value  adjustments  are  used,  the  study  should  docu¬ 
ment  the  major  assumptions,  such  as  those  concerning  the  choice  of 
discount  rates,  the  selection  of  the  system  lifetime,  and  the  particu¬ 
lar  procedure  used  to  determine  the  residual  values. 

c.  Studies  Intended  for  immediate  use  in  making  major  force 
decisions,  particular’ y  where  specific  force  levels  and  phasings  are 
involved  should,  in  general,  emphasize  the  more  realistic  cost  measures, 
annual  and  cumulative  costs,  as  distinguished  from  the  aggregative  cost 
measures  using  some  number  of  years  of  level -off  operating  cost.  When 
used  for  specific,  time -phased ,  force  recommendations ,  this  will  permit 
the  study  to  provide  a  more  accurate  reading  of  the  actual  funding  im¬ 
plications.  Realistic  considerations  such  as  the  phasing-ln  periods 
and  phasing-out  periods  will  then  be  Incorporated,  and  costs  and  effec¬ 
tiveness  time  patterns  can  be  examined  for  undesirable  peaks  or  dip*. 
Both  the  annual  costs  and  the  cumulative  costs  through  selected  time 
periods  should  be  shown. 

d.  For  those  studies  which  emphasize  comparisons  (without 
aiming  at  specific  tlme-nhased  force  level  recommendations)  involving 
systems  or  designs  with  approximately  the  same  life  cycles,  the  cost 
measures  using  the  sum  of  development,  Investment,  and  some  specified 
number  of  years  of  level -rff  operating  costs  should  be  used.  Many  CDP 
studies  and  Concept  Formulation  studies  will  probably  fall  into  this 
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category.  The  coats  obtained  ere  not  aa  realistic  but  would  provide 
sufficient  Information  for  the  more  limited  study  objectives  of  making 
"snapshot”  comparisons  among  alternative  systems  or  among  alternative 
designs  of  a  specific  system.  Thus,  this  measure  should  be  most  useful 
for  studies  emphasizing  the  screening  of  candidates  with  the  same  time 
phasing,  while  the  time -phased  cost  measures  should  be  used  In  studies 
which  compare  alternative  force  levels  and  phasings  utilizing  the  major 
candidate  systems  which  survived  the  screening  studies. 

e.  Where  discounting  Is  applied,  the  discount  rate  should 
tellect  only  the  time  value  of  money.  It  should,  In  general,  not  In¬ 
clude  an  allowance  for  "uncertainty."  As  described  In  (10),  the  prob¬ 
lem  cf  cost  uncertainty  should  preferably  be  expressed  explicitly  and 
not  "lumped"  Into  a  rate  such  as  used  in  discounting.  No  official  DOD 
discount  rate  has  been  established.  Rates  between  5  and  10  percent 
should  normally  be  used.  Rates  used  outside  this  region  should  be 
explained . 


f.  When  time-phased  costs  are  shown,  these  costs  should,  in 
general,  represent  Total  Obligational  Authority  (TOA)  for  each  fiscal 
year  rather  than  Expenditures.  They  should  be  on  a  fiscal  year  rather 
than  on  a  calendar  year  basis. 

12.  Some  systems  considered  In  a  study  may  have  applicability  to 
other  missions  or  other  uses  which  are  not  directly  considered  in  the 
study.  No  completely  satisfactory  procedure  for  handling  these  situa¬ 
tions  is  currently  known.  In  general,  however,  cost  deductions  should 
not  be  made  to  those  systems  which  do  have  such  spillover  effects.  In 
any  case,  a  discussion  of  any  side  benefits  accruing  to  each  of  the 
candidate  systems  should  be  clearly  indicated  and  would  have  to  be  con¬ 
sidered  when  making  study  conclusions. 

13.  The  major  problem  In  cost  analyses,  of  course,  Is  that  of  pre¬ 
paring  the  basic  cost  estimates.  Some  general  principles  can  be  stated: 

a,  A  first  step  Is  to  establish,  and  carefully  define,  a  set 
of  "cost  categories"  for  each  type  of  system  being  costed,  as  for  exampl 
fuel  cost,  maintenance  cost,  airframe  production,  etc.  This  set  of 
cost  categories  should  Include  all  algnlflcant  costs  without  duplication 
As  Indicated  earlier,  It  Is  desirable  that  these  cost  categories  be  com¬ 
patible  with  the  official  Military  Department  categories.  The  format 

In  Exhibit  1  illustrates  such  a  set  of  categories  which  recently  wns 
ueed  In  a  major  force  structure  analysis.  However,  more  detail,  par¬ 
ticularly  In  CDP  studies,  may  be  desirable  for  particular  studies. 

Each  cost  category  should  be  such  as  to  permit  Its  costs  to  be  distin¬ 
guished  from  that  of  any  other  coot  category. 

b.  Where  considerable  cost  uncertainty  exists,  emphasis  should 
be  placed  upon  the  consistency  of  assumptions  among  the  alternatives 
being  compared.  Though  the  absolute  value  for  each  alternative  may  ba 
In  considerable  doubt,  at  times  more  confidence  may  be  had  In  the  rela¬ 
tive  costs,  thereby  providing  useful  comparative  Information. 
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c.  In  making  estimates  of  costs  for  systems  currently  in  the 
inventory,  data  on  recent  actual  costs  will  rormally  be  the  nest  source 
of  data  for  making  projections  into  the  future  (modified,  of  course, 
for  anticipated  changes). 

d.  In  making  estimat*.s  of  costs  for  future  systems,  those 
not  in  the  Inventory  and  perhaps  only  in  the  most  preliminary  design 
stages,  other  procedures  are  necessary.  "Engineering  estimates,"  those 
based  primarily  upon  examination  of  the  components  of  the  specific  sys¬ 
tem  proposed,  is  the  most  common  method  applied.  Another  technique  is 
strongly  recormended  to  be  used  with  (and,  in  situations  where  engi¬ 
neering  estimates  are  not  feasible,  replace)  the  engineering  estimates. 
This  is  to  de/elop  estimating  relationships  based  upon  historical  data 
on  other  programs,  which  relate  Individual  elements  of  cost  to  selected 
physical  and  performance  characteristics  of  the  item.  Statistical  re¬ 
gression  analysis  hab  been  usually  utilized  in  this  process. 

Where  statistical  cost -estimating  relations  are  used  in  a  study 
and  they  are  obtained  from  available,  documented  courses,  reference  to 
those  sources  along  with  necessary  commentary  as  to  the  specific  appli¬ 
cation  will  normally  be  sufficient  documentation . 
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Exhlblt  1 

ILLUSTRATIVE  FORMAT  OF  COST  FACTOR  SHEET* 
HYPOTHETICAL  AIR  FORCE  AIRCRAFT  SYSTEM 


COST  CATEGORIES 

FACTOR/COST 

BASIS  OF  ESTIMATE 

RAD 

Airframe 

$11  OH 

Statistical  cost-estimating 
relation;  see  Note  1** 

Engines 

$  35M 

Modified  contractor  A  es¬ 
timate;  see  Note  2** 

Avionics 

$  20M 

Modified  Contractor  B 
estimate;  see  Note  3** 

Total 

$165M 

(These  notes  on  RAD  should 
Indicate  the  specific  years 
and  costs  for  each  year.)** 

INVESTMENT 

Related  to  Flyaway  Cost 

Aircraft  flyaway 

Cost-quantity  curves 
for  airframe,  engines, 
and  avionics  costs 
should  be  attached. 

(An  example  is  shorn 

In  Exhibit  2.) 

15  UE  aircraft/squadron 
+  2  cotnnand  support  acft/sq 
+  attrition  acft.  (See 

Note  4**  for  method  of  com¬ 
puting  attrition  acft.)  (Set 
Note  5**  for  presentation 
and  explanation  of  cost- 
estlmatlng  relations  used  tc 
derive  the  flyaway  cost 
curves .) 

Initial  spares 

221  of  acft  flyaway 

Modified  A F  factor;  see 

Note  6** 

Peculiar  ACE 

2X  of  acft  flyaway 

Modified  AF  factor;  see 

Note  7** 

Technical  data 

of  acft  flyaway 

Modified  AF  factor;  see 

Note  8** 

Related  to  No,  of  Sq 
Military  construction 
Consnon  AGE 

$5M  per  dispersal  site 
$1M  per  sqi  adron 

Estimate:  see  Noce  9** 

AF  factor;  see  Note  10** 

Initial  personnal 
training 

$9M  per  squadron 

250  Officers  @  $8400  per  sq. 
1800  Airmen  0  3600  per  sq. 
See  Note  11** 
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Fxhibit  1  (Cont.) 


COST  CATEGORIES 

FACTOR/COST 

BASIS  OF  ESTIMATE 

RECURRING 

Related  to  Flyaway  Cost 
Modifications  +  common  AGE 

2.57.  cum  avg  flyaway 

See  Note  12** 

Related  to  No.  Sq  POL 

$1 .1M  squad/ yr 

$210  per  flying  hour; 

360  F.H./UE  acft/yr ; 
see  Note  13** 

Depot  maintenance 

$1 .4M/ squad/yr 

$250  per  flying  hour; 

360  F.H./UE  acft/yr; 
see  Note  Id** 

Replenishment  spares 

$1 . 3M/ squad/yr 

$240  per  flying  hour; 

360  F.H./UE  acft/yr; 
sec  Note  15** 

Pay  4  allowances--offlcers 

$2.9M/ squad/ yr 

250  off iccrs/squad  @ 
$ll,400/yr;  see  Note  16** 

Pay  &  allowances --airmen 

$7 . 9M/ squad/ >r 

1800  airmen/squad  @ 
$4400/ yr;  see  Note  17** 

Pay--civilians 

$0 . 3M/ squad/ yr 

40  civilians/squad  @ 
$7100/yr;  see  Note  18** 

Other  support 

$2. 7M/ squad/yr 

$1300/military; 
see  Note  19** 

Replacement  training 

$2.3M/ squad/ yr 

257.  turnover  rate  (see 
"initial  training”); 
see  Note  11** 

Total 

$19. 9M/ squad/ yr 

IV.  OTHER 

Missiles:  A  separate  Cost  Factor  sheet  should  be  provided  to  display  the 
costs  and  to  indicate  the  method  for  computing  the  number  of 
missiles  required  per  aircraft  squadron. 

Tankers:  A  separate  Cost  Factor  sheet  should  be  provided  to  display  the 

tanker  cost  factors  and  to  indicate  the  number  of  tankers  re¬ 
quired  per  aircraft  squadron 


This  is  purely  an  illustration  to  give  an  idea  as  to  the  type  of  information  de¬ 
sired.  Both  the  list  of  cost  categories  and  the  specific  factors  and  costs  used 
should  be  established  to  meet  the  needs  of  each  individual  jtudy.  CDP  studies,  for 
example,  may  require  considerably  more  subsystem  detail. 

** 

Notes  1-19  should  further  describe  the  basis  for  the  factors  or  costs  including 
the  sources  from  which  obtained. 
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